[ 521.505586] env[64990]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.505586] env[64990]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.500726] env[65080]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.500726] env[65080]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.373761] env[65080]: INFO neutron.common.config [-] Logging enabled! [ 524.374123] env[65080]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev53 [ 524.374279] env[65080]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65080) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.374589] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.374684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.375531] env[65080]: WARNING oslo_policy.policy [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.375738] env[65080]: WARNING oslo_policy.policy [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.377421] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] VMware NSXv3 Agent initialized successfully. [ 524.377774] env[65080]: DEBUG oslo_concurrency.lockutils [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Acquiring lock "singleton_lock" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.377905] env[65080]: DEBUG oslo_concurrency.lockutils [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Acquired lock "singleton_lock" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.378125] env[65080]: DEBUG oslo_concurrency.lockutils [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Releasing lock "singleton_lock" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.378416] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Full set of CONF: {{(pid=65080) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.378526] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ******************************************************************************** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.378626] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Configuration options gathered from: {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.379301] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.379476] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.379585] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ================================================================================ {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.379756] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] agent_down_time = 75 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.379897] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] allow_automatic_dhcp_failover = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380046] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] allow_bulk = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380193] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] api_extensions_path = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380336] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] api_paste_config = api-paste.ini {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380477] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] auth_strategy = keystone {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380582] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] backdoor_port = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380682] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] backdoor_socket = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380818] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] backlog = 4096 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.380954] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381135] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] bind_host = 0.0.0.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381400] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] bind_port = 9696 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381491] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] client_socket_timeout = 900 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381644] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] config_dir = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381753] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.381892] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] config_source = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382043] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] control_exchange = neutron {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382193] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] core_plugin = ml2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382353] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] debug = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382494] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] default_availability_zones = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382700] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382836] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dhcp_agent_notification = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.382971] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dhcp_agents_per_network = 1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383118] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dhcp_lease_duration = 86400 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383258] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dhcp_load_type = networks {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383393] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dns_domain = openstacklocal {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383526] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383654] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_default_route_bfd = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383781] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_default_route_ecmp = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.383907] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_dvr = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384045] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_new_agents = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384176] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384308] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_signals = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384433] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] enable_traditional_dhcp = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384558] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] external_dns_driver = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.384687] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] filter_validation = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] global_physnet_mtu = 8950 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] graceful_shutdown_timeout = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] host = cpu-1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] host_dvr_for_dhcp = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] http_retries = 3 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] instance_format = [instance: %(uuid)s] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.386863] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ipam_driver = internal {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ipv6_pd_enabled = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] l3_ha = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] l3_ha_network_physical_name = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] l3_ha_network_type = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387142] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_color = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_config_append = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_dir = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_file = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_options = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387320] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_rotate_interval = 1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387478] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_rotate_interval_type = days {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387642] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] log_rotation_type = none {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387642] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387708] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387853] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.387977] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388094] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388231] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_dns_nameservers = 5 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388360] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_header_line = 16384 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388487] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_l3_agents_per_router = 3 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388613] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_logfile_count = 30 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388739] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_logfile_size_mb = 200 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388864] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] max_subnet_host_routes = 20 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.388997] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] my_ip = 10.180.1.21 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389146] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] my_ipv6 = ::1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389275] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] network_auto_schedule = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389398] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] network_link_prefix = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389535] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389670] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] notify_nova_on_port_data_changes = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389803] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] notify_nova_on_port_status_changes = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.389938] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] pagination_max_limit = -1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390078] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] publish_errors = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390210] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rate_limit_burst = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390346] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rate_limit_except_level = CRITICAL {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390475] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rate_limit_interval = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390607] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] retry_until_window = 30 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390736] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] router_distributed = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390865] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rpc_resources_processing_step = 20 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.390994] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rpc_response_max_timeout = 600 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391168] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] rpc_response_timeout = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391304] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] send_events_interval = 2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391452] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] service_plugins = ['router'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391590] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] setproctitle = on {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391717] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] shell_completion = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391850] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] state_path = /opt/stack/data/neutron {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.391985] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] syslog_log_facility = LOG_USER {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392131] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] tcp_keepidle = 600 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392292] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] transport_url = **** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392429] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] use_journal = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392556] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] use_json = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392682] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] use_ssl = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392806] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] use_stderr = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.392942] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] use_syslog = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393083] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vlan_qinq = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393210] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vlan_transparent = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393337] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] watch_log_file = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393468] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] wsgi_default_pool_size = 100 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393591] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] wsgi_keep_alive = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393767] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.393905] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] wsgi_server_debug = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.394069] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_concurrency.disable_process_locking = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394218] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394362] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394496] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394634] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394773] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.394910] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395075] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.connection_string = messaging:// {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395247] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.enabled = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395396] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.es_doc_type = notification {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395531] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.es_scroll_size = 10000 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395670] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.es_scroll_time = 2m {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395804] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.filter_error_trace = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.395942] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.hmac_keys = **** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396091] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.sentinel_service_name = mymaster {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396240] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.socket_timeout = 0.1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396374] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.trace_requests = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396504] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler.trace_sqlalchemy = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396651] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler_jaeger.process_tags = {} {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396783] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler_jaeger.service_name_prefix = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.396914] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] profiler_otlp.service_name_prefix = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.397075] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.enforce_new_defaults = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.397353] env[65080]: WARNING oslo_config.cfg [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.397505] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.enforce_scope = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.397646] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.policy_default_rule = default {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.397796] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.397979] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398091] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398223] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398353] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398481] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398610] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398748] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.398894] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399069] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] agent.extensions = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399221] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399367] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] service_providers.service_provider = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399514] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.default_quota = -1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399658] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399792] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_floatingip = 50 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.399927] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_network = 100 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400070] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_port = 500 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400205] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400337] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_router = 10 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400469] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_security_group = 10 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400617] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400816] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.quota_subnet = 100 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.400965] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] QUOTAS.track_quota_usage = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401159] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401298] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401432] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401566] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401704] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401837] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.401966] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402122] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402279] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402455] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402595] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402732] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402865] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.402996] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_dhcp_release.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403153] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403286] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403416] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403548] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403683] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403816] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.403947] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_ovs_vsctl.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404099] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.capabilities = [21] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404231] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404360] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404491] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404627] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404759] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.404887] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_namespace.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405041] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.capabilities = [12] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405173] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405304] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405434] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405570] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405703] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405831] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_conntrack.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.405969] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.capabilities = [12, 21] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406110] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.group = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406240] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.helper_command = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406370] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.log_daemon_traceback = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406505] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406636] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.thread_pool_size = 8 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406764] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] privsep_link.user = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.406918] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407072] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407235] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.continue_on_failed_promotions = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407376] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.dscp = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407510] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.dscp_inherit = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407650] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.force_mp_to_policy = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407781] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.locking_coordinator_url = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.407912] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.log_agent_heartbeats = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408095] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.logging_expire = 1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408202] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408337] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408477] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.polling_interval = 240 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408610] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408750] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.408889] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.report_interval = 30.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409040] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409184] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409326] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409463] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.sync_skew = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409599] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.synchronization_queue_size = 20 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409731] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT.use_helper_for_ns_read = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.409872] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] SECURITYGROUP.enable_ipset = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410014] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] SECURITYGROUP.enable_security_group = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410159] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410299] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410438] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] experimental.ipv6_pd_enabled = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410590] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.extension_drivers = ['port_security'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410750] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.external_network_type = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.410904] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411058] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.overlay_ip_version = 4 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411224] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.path_mtu = 8950 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411371] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.physical_network_mtus = {} {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411518] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411657] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411798] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ml2.type_drivers = ['vlan'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.411938] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412098] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412255] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412444] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412601] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412743] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.412884] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413036] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413180] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413386] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413533] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_login_password = **** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413677] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.413816] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_login_user = admin {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414016] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414245] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414410] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414576] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414743] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.414895] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.415127] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.415393] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.415641] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.415821] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416016] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416195] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416360] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416584] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416738] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.416881] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417030] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417177] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.auth_section = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417326] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.auth_type = password {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417467] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417599] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.certfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417736] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.collect_timing = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.417880] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.endpoint_type = public {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418028] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.insecure = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418218] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.keyfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418291] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.region_name = RegionOne {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418428] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.split_loggers = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418559] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] nova.timeout = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418697] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.auth_section = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418840] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.auth_type = password {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.418983] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419163] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.certfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419303] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.collect_timing = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419443] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.endpoint_type = public {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419575] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.insecure = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419704] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.keyfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419830] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.region_name = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.419960] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.split_loggers = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.420120] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] placement.timeout = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.420274] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.auth_section = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.420422] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.auth_type = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.420625] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.cafile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.420843] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.certfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421071] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.collect_timing = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421251] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.connect_retries = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421395] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.connect_retry_delay = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421533] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.enable_notifications = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421667] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.endpoint_override = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421800] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.insecure = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.421930] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.interface = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422074] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.keyfile = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422214] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.max_version = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422345] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.min_version = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422519] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.region_name = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422674] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.retriable_status_codes = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422823] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.service_name = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.422981] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.service_type = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423140] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.split_loggers = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423276] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.status_code_retries = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423408] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.status_code_retry_delay = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423539] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.timeout = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423668] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.valid_interfaces = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423795] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ironic.version = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.423933] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] cli_script.dry_run = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424111] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424275] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424440] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424578] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424713] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424845] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.424975] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425158] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425307] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425453] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425588] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425730] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.425873] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426060] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426214] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426360] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426496] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426632] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426773] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.426908] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427051] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427186] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427319] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427467] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427614] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427738] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.427867] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428008] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428169] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428350] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428442] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428582] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428723] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.428856] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429009] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429186] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429371] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429529] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_notifications.driver = [] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429666] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_notifications.retry = -1 {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429817] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.429953] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.430070] env[65080]: DEBUG oslo_service.backend._eventlet.service [None req-5c8ffcd1-8a41-4915-a5aa-ddacab0cf887 None None] ******************************************************************************** {{(pid=65080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.431277] env[65080]: DEBUG neutron.agent.securitygroups_rpc [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Init firewall settings (driver=nsxv3) {{(pid=65080) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.432663] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65080) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.432909] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.435246] env[65080]: DEBUG dogpile.cache.region [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.435375] env[65080]: DEBUG dogpile.lock [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.435473] env[65080]: DEBUG dogpile.lock [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.435564] env[65080]: DEBUG dogpile.lock [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.435656] env[65080]: DEBUG dogpile.cache.region [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.435742] env[65080]: DEBUG dogpile.lock [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.435905] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.458647] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Session token - acquiring [ 524.460324] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.460504] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.460614] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.461052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.472914] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.770086] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.794373] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.794566] env[65080]: DEBUG dogpile.cache.region [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Cache value generated in 0.359 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.794687] env[65080]: DEBUG dogpile.lock [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.794742] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Activating Policy API Provider. [ 524.794938] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Looking for the default Infrastructure Rules. [ 524.866619] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Looking for the Default Layer3 Logged Drop Section. [ 524.885815] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.886344] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.886503] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.886607] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.886892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.887259] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.403186] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.905359] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.407776] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Inventory metadata is going to be refreshed. [ 526.408241] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.203251] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.203622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.203622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.203883] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.215185] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.216080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.216961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.235475] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.235909] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.235909] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.236386] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.236386] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.236386] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.236614] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.236614] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.257088] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.257391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.257391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.257672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.257846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.257989] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.279132] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.279381] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.279424] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.279708] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.279854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.279999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.300014] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.300265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.300317] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.300618] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.300759] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.300908] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.301016] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.301116] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.320398] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.320648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.320749] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.320966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.321100] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.321301] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.321405] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.321505] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.343748] env[65080]: DEBUG networking_nsxv3.common.locking [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.344089] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.344089] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.344331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.344473] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.344624] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.344727] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.344826] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Inventory metadata have been refreshed. [ 527.344920] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Dryrun:True. Metadata refresh completed. [ 527.345042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Releasing lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.346695] env[65080]: INFO neutron.agent.agent_extensions_manager [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Loaded agent extensions: [] [ 527.347411] env[65080]: DEBUG neutron_lib.callbacks.manager [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65080) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.401228] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.401388] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.401464] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent out of sync with plugin! [ 532.348434] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.348434] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.349856] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.349856] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.018694] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6866c959-5000-4616-a455-60e8d08b7296 demo admin] Enqueued Resource ID: d5bb7efd-ac5b-46b0-acf4-e7133e78037a with Priority: HIGHEST for action security_group_rules [ 542.019202] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5bb7efd-ac5b-46b0-acf4-e7133e78037a with Priority: HIGHEST for action security_group_rules [ 542.019699] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5bb7efd-ac5b-46b0-acf4-e7133e78037a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.019828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5bb7efd-ac5b-46b0-acf4-e7133e78037a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.019894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5bb7efd-ac5b-46b0-acf4-e7133e78037a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.020339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5bb7efd-ac5b-46b0-acf4-e7133e78037a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.020450] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5bb7efd-ac5b-46b0-acf4-e7133e78037a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.541984] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.542309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.542309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.542511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.542564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.542645] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5bb7efd-ac5b-46b0-acf4-e7133e78037a already deleted. [ 542.542732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5bb7efd-ac5b-46b0-acf4-e7133e78037a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.020986] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.020986] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.022278] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.022278] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.350261] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.350663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.350663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.350663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.350849] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.853932] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.356498] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.858981] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 555.859220] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 556.692528] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.693036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.693036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.693036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.704896] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 556.705679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.706287] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 556.727274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.727507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.727507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.727659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.727744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.727851] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 556.727923] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.727992] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 556.748570] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.748757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.748757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.748943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.749091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.749199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 556.767924] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.768147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.768147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.768321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.768421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.768527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 556.787015] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.787221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.787221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.787400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.787506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.787620] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 556.787732] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.787785] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 556.804092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.804398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.804398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.804518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.804565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.804662] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 556.804735] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.804805] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 556.824351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.824564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.824564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.824824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.824927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.825053] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 556.825127] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.825193] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 556.825253] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 556.825327] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 556.825401] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 556.825465] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 556.825710] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 556.825810] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 556.825860] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 556.844078] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.844264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.844264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.844450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.844551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.844664] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 556.862487] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.862682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.862682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.862860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.862957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.897175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.023020] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.023215] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.024590] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.024943] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.026077] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.026586] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.271748] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b8769800-0bbb-4848-8e6b-6b7cb0bf414d None None] Enqueued Resource ID: 755d6d84-6483-4bc4-8d4c-e484e3eaae3e with Priority: HIGHEST for action port [ 570.272397] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755d6d84-6483-4bc4-8d4c-e484e3eaae3e with Priority: HIGHEST for action port [ 570.272729] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-755d6d84-6483-4bc4-8d4c-e484e3eaae3e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.272826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-755d6d84-6483-4bc4-8d4c-e484e3eaae3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.272911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-755d6d84-6483-4bc4-8d4c-e484e3eaae3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.274444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-755d6d84-6483-4bc4-8d4c-e484e3eaae3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.274516] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('755d6d84-6483-4bc4-8d4c-e484e3eaae3e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.777999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 755d6d84-6483-4bc4-8d4c-e484e3eaae3e [ 570.779349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.779349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.779349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.779349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.779860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.779965] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:755d6d84-6483-4bc4-8d4c-e484e3eaae3e already deleted. [ 570.780112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-755d6d84-6483-4bc4-8d4c-e484e3eaae3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.079667] env[65080]: INFO networking_nsxv3.common.synchronization [None req-04fe4bae-dea6-46f0-9421-1aa105334a09 None None] Enqueued Resource ID: 4141af59-61d6-4c01-b0b4-e910facedd05 with Priority: HIGHEST for action port [ 572.079944] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4141af59-61d6-4c01-b0b4-e910facedd05 with Priority: HIGHEST for action port [ 572.080922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4141af59-61d6-4c01-b0b4-e910facedd05 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.080922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4141af59-61d6-4c01-b0b4-e910facedd05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.080922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4141af59-61d6-4c01-b0b4-e910facedd05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.080922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4141af59-61d6-4c01-b0b4-e910facedd05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.080922] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4141af59-61d6-4c01-b0b4-e910facedd05',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.324330] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3f0c5a48-eb1e-46ae-add4-27e91c3810a4 None None] Enqueued Resource ID: affd8ff8-51f5-4f62-aad1-15abb711ce86 with Priority: HIGHEST for action port [ 572.324330] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: affd8ff8-51f5-4f62-aad1-15abb711ce86 with Priority: HIGHEST for action port [ 572.324785] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-affd8ff8-51f5-4f62-aad1-15abb711ce86 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.324923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-affd8ff8-51f5-4f62-aad1-15abb711ce86" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.324997] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-affd8ff8-51f5-4f62-aad1-15abb711ce86" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.325396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-affd8ff8-51f5-4f62-aad1-15abb711ce86" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.325396] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('affd8ff8-51f5-4f62-aad1-15abb711ce86',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.583169] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4141af59-61d6-4c01-b0b4-e910facedd05 [ 572.583987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.584273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.584379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.584592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.584681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.584935] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4141af59-61d6-4c01-b0b4-e910facedd05 already deleted. [ 572.584935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4141af59-61d6-4c01-b0b4-e910facedd05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.828128] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port affd8ff8-51f5-4f62-aad1-15abb711ce86 [ 572.828645] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.828758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.828758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.829051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.829092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.829175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:affd8ff8-51f5-4f62-aad1-15abb711ce86 already deleted. [ 572.829259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-affd8ff8-51f5-4f62-aad1-15abb711ce86" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.977171] env[65080]: INFO networking_nsxv3.common.synchronization [None req-1cf302b0-f90a-4c33-aeb4-bcd241116d1d None None] Enqueued Resource ID: 1b711117-bc54-45ad-b75d-779db83e0e42 with Priority: HIGHEST for action port [ 573.977426] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b711117-bc54-45ad-b75d-779db83e0e42 with Priority: HIGHEST for action port [ 573.978174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b711117-bc54-45ad-b75d-779db83e0e42 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.978174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b711117-bc54-45ad-b75d-779db83e0e42" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.978174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b711117-bc54-45ad-b75d-779db83e0e42" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.978392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b711117-bc54-45ad-b75d-779db83e0e42" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.978475] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b711117-bc54-45ad-b75d-779db83e0e42',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.399539] env[65080]: INFO networking_nsxv3.common.synchronization [None req-ff5473e2-dc75-4e88-b9c5-179526aae51d None None] Enqueued Resource ID: 0da8a0f4-8e96-4e33-8761-5d849fa9860d with Priority: HIGHEST for action port [ 574.399888] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8a0f4-8e96-4e33-8761-5d849fa9860d with Priority: HIGHEST for action port [ 574.400432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0da8a0f4-8e96-4e33-8761-5d849fa9860d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.400491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0da8a0f4-8e96-4e33-8761-5d849fa9860d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.400522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0da8a0f4-8e96-4e33-8761-5d849fa9860d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.400765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0da8a0f4-8e96-4e33-8761-5d849fa9860d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.400852] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da8a0f4-8e96-4e33-8761-5d849fa9860d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.484797] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b711117-bc54-45ad-b75d-779db83e0e42 [ 574.485054] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.485153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.485216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.485429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.485517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.485611] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b711117-bc54-45ad-b75d-779db83e0e42 already deleted. [ 574.485690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b711117-bc54-45ad-b75d-779db83e0e42" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.735110] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7ce0c78b-8ee6-491e-95ad-c981f604b967 None None] Enqueued Resource ID: bd81e903-71dd-4919-9f01-01976151d415 with Priority: HIGHEST for action port [ 574.736073] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd81e903-71dd-4919-9f01-01976151d415 with Priority: HIGHEST for action port [ 574.736073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd81e903-71dd-4919-9f01-01976151d415 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.737303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd81e903-71dd-4919-9f01-01976151d415" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.737421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd81e903-71dd-4919-9f01-01976151d415" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.737671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd81e903-71dd-4919-9f01-01976151d415" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.737759] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd81e903-71dd-4919-9f01-01976151d415',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.904153] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0da8a0f4-8e96-4e33-8761-5d849fa9860d [ 574.904423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.904559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.904632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.904836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.904923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.905028] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0da8a0f4-8e96-4e33-8761-5d849fa9860d already deleted. [ 574.905111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0da8a0f4-8e96-4e33-8761-5d849fa9860d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.241407] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd81e903-71dd-4919-9f01-01976151d415 [ 575.241407] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.241682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.241682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.241740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.242010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.242010] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd81e903-71dd-4919-9f01-01976151d415 already deleted. [ 575.242010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd81e903-71dd-4919-9f01-01976151d415" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.139158] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c9dc2c03-d200-4c9d-82f4-142dcd529fd3 None None] Enqueued Resource ID: 5e1a4a4e-5a05-4420-91f7-7928e3aeded8 with Priority: HIGHEST for action port [ 576.139730] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e1a4a4e-5a05-4420-91f7-7928e3aeded8 with Priority: HIGHEST for action port [ 576.140063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e1a4a4e-5a05-4420-91f7-7928e3aeded8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.140211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e1a4a4e-5a05-4420-91f7-7928e3aeded8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.140268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e1a4a4e-5a05-4420-91f7-7928e3aeded8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.140533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e1a4a4e-5a05-4420-91f7-7928e3aeded8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.140617] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e1a4a4e-5a05-4420-91f7-7928e3aeded8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.601124] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c7cf3b3b-ac4f-4cac-8d71-11d583ac61fc None None] Enqueued Resource ID: 577afc80-d0f1-4ed1-b15c-d4f332f668cd with Priority: HIGHEST for action port [ 576.601124] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 577afc80-d0f1-4ed1-b15c-d4f332f668cd with Priority: HIGHEST for action port [ 576.601124] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-577afc80-d0f1-4ed1-b15c-d4f332f668cd taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.601124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-577afc80-d0f1-4ed1-b15c-d4f332f668cd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.602023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-577afc80-d0f1-4ed1-b15c-d4f332f668cd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.602434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-577afc80-d0f1-4ed1-b15c-d4f332f668cd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.602612] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('577afc80-d0f1-4ed1-b15c-d4f332f668cd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.644441] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e1a4a4e-5a05-4420-91f7-7928e3aeded8 [ 576.644441] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.644441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.644441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.644441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.644441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.644441] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e1a4a4e-5a05-4420-91f7-7928e3aeded8 already deleted. [ 576.644441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e1a4a4e-5a05-4420-91f7-7928e3aeded8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.108483] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 577afc80-d0f1-4ed1-b15c-d4f332f668cd [ 577.108864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.108969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.109069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.109503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.109503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.109640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:577afc80-d0f1-4ed1-b15c-d4f332f668cd already deleted. [ 577.109704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-577afc80-d0f1-4ed1-b15c-d4f332f668cd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.853582] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3f753218-845c-4157-93e7-f81a4882ef98 None None] Enqueued Resource ID: 0e57dc60-1dd4-47cd-9cc8-d27617d525bf with Priority: HIGHEST for action port [ 578.854174] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e57dc60-1dd4-47cd-9cc8-d27617d525bf with Priority: HIGHEST for action port [ 578.854482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e57dc60-1dd4-47cd-9cc8-d27617d525bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.854653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e57dc60-1dd4-47cd-9cc8-d27617d525bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.854732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e57dc60-1dd4-47cd-9cc8-d27617d525bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.854933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e57dc60-1dd4-47cd-9cc8-d27617d525bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.855026] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e57dc60-1dd4-47cd-9cc8-d27617d525bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.358242] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e57dc60-1dd4-47cd-9cc8-d27617d525bf [ 579.359393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.359538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.359588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.359848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.359996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.361173] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e57dc60-1dd4-47cd-9cc8-d27617d525bf already deleted. [ 579.361173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e57dc60-1dd4-47cd-9cc8-d27617d525bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.715521] env[65080]: INFO networking_nsxv3.common.synchronization [None req-59a5eba1-5784-4cc5-8047-4b79e92aef71 None None] Enqueued Resource ID: f831b252-c38a-4193-bc1d-a4a7a2ba8169 with Priority: HIGHEST for action port [ 579.716019] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f831b252-c38a-4193-bc1d-a4a7a2ba8169 with Priority: HIGHEST for action port [ 579.717041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f831b252-c38a-4193-bc1d-a4a7a2ba8169 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.717201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f831b252-c38a-4193-bc1d-a4a7a2ba8169" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.717508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f831b252-c38a-4193-bc1d-a4a7a2ba8169" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.717588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f831b252-c38a-4193-bc1d-a4a7a2ba8169" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.717632] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f831b252-c38a-4193-bc1d-a4a7a2ba8169',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.222268] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f831b252-c38a-4193-bc1d-a4a7a2ba8169 [ 580.222531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.222598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.222695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.222885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.223022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.223115] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f831b252-c38a-4193-bc1d-a4a7a2ba8169 already deleted. [ 580.223199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f831b252-c38a-4193-bc1d-a4a7a2ba8169" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.756034] env[65080]: INFO networking_nsxv3.common.synchronization [None req-66bb83ff-98fd-467d-8b1f-dd96427dd7f9 None None] Enqueued Resource ID: 4c660c23-338a-4bfd-aa10-57334bcc1165 with Priority: HIGHEST for action port [ 580.756544] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c660c23-338a-4bfd-aa10-57334bcc1165 with Priority: HIGHEST for action port [ 580.756836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c660c23-338a-4bfd-aa10-57334bcc1165 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.756961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c660c23-338a-4bfd-aa10-57334bcc1165" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.758053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c660c23-338a-4bfd-aa10-57334bcc1165" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.758374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c660c23-338a-4bfd-aa10-57334bcc1165" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.758431] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c660c23-338a-4bfd-aa10-57334bcc1165',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.260331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c660c23-338a-4bfd-aa10-57334bcc1165 [ 581.260880] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.260880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.260880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.261165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.261165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.261165] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c660c23-338a-4bfd-aa10-57334bcc1165 already deleted. [ 581.261309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c660c23-338a-4bfd-aa10-57334bcc1165" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.591915] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5f793363-cc44-4ed5-a072-2f2722624ea8 None None] Enqueued Resource ID: be5f7047-0abd-441e-a4b3-997df4c91eb7 with Priority: HIGHEST for action port [ 581.592756] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be5f7047-0abd-441e-a4b3-997df4c91eb7 with Priority: HIGHEST for action port [ 581.594770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-be5f7047-0abd-441e-a4b3-997df4c91eb7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.594770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be5f7047-0abd-441e-a4b3-997df4c91eb7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.594770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be5f7047-0abd-441e-a4b3-997df4c91eb7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.595032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be5f7047-0abd-441e-a4b3-997df4c91eb7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.595118] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be5f7047-0abd-441e-a4b3-997df4c91eb7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.719867] env[65080]: INFO networking_nsxv3.common.synchronization [None req-0b4a6152-e688-448d-b012-53d2357a30cc None None] Enqueued Resource ID: 511c7dad-96fa-4745-8568-157e141b4789 with Priority: HIGHEST for action port [ 581.719867] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511c7dad-96fa-4745-8568-157e141b4789 with Priority: HIGHEST for action port [ 581.721140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-511c7dad-96fa-4745-8568-157e141b4789 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.721469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-511c7dad-96fa-4745-8568-157e141b4789" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.721595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-511c7dad-96fa-4745-8568-157e141b4789" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.721850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-511c7dad-96fa-4745-8568-157e141b4789" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.721985] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511c7dad-96fa-4745-8568-157e141b4789',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.096605] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be5f7047-0abd-441e-a4b3-997df4c91eb7 [ 582.097057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.097332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.097781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.098112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.098297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.098472] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be5f7047-0abd-441e-a4b3-997df4c91eb7 already deleted. [ 582.098655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be5f7047-0abd-441e-a4b3-997df4c91eb7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.224905] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 511c7dad-96fa-4745-8568-157e141b4789 [ 582.225424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.225424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.225424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.225611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.225647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.225712] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:511c7dad-96fa-4745-8568-157e141b4789 already deleted. [ 582.225791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-511c7dad-96fa-4745-8568-157e141b4789" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.404866] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5b06749e-eebf-4dcf-8c05-1d3d2c8e4006 None None] Enqueued Resource ID: a454d0f5-ed1e-4615-9d80-0366f8fd2178 with Priority: HIGHEST for action port [ 582.405548] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a454d0f5-ed1e-4615-9d80-0366f8fd2178 with Priority: HIGHEST for action port [ 582.406034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a454d0f5-ed1e-4615-9d80-0366f8fd2178 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.406164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a454d0f5-ed1e-4615-9d80-0366f8fd2178" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.406232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a454d0f5-ed1e-4615-9d80-0366f8fd2178" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.406473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a454d0f5-ed1e-4615-9d80-0366f8fd2178" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.406623] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a454d0f5-ed1e-4615-9d80-0366f8fd2178',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.913060] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a454d0f5-ed1e-4615-9d80-0366f8fd2178 [ 582.913297] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.913429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.913505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.913709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.913813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.913923] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a454d0f5-ed1e-4615-9d80-0366f8fd2178 already deleted. [ 582.914021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a454d0f5-ed1e-4615-9d80-0366f8fd2178" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.441183] env[65080]: INFO networking_nsxv3.common.synchronization [None req-da51bc52-0e01-42d6-9137-e6834554c3a8 None None] Enqueued Resource ID: efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7 with Priority: HIGHEST for action port [ 583.441183] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7 with Priority: HIGHEST for action port [ 583.441183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.441183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.441183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.441183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.441183] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.892050] env[65080]: INFO networking_nsxv3.common.synchronization [None req-0e801a6c-2100-4e7a-8501-9e08279bb170 None None] Enqueued Resource ID: 6a44237e-330d-4cc7-8026-7e723dcc641f with Priority: HIGHEST for action port [ 583.892581] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a44237e-330d-4cc7-8026-7e723dcc641f with Priority: HIGHEST for action port [ 583.892986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a44237e-330d-4cc7-8026-7e723dcc641f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.893102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a44237e-330d-4cc7-8026-7e723dcc641f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.895433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a44237e-330d-4cc7-8026-7e723dcc641f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.895433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a44237e-330d-4cc7-8026-7e723dcc641f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.895433] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a44237e-330d-4cc7-8026-7e723dcc641f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.943902] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7 [ 583.943902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.944091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.944091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.944271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.944360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.944530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7 already deleted. [ 583.944530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efbf79b0-8bc4-4bba-8daf-b93b9d9d53a7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.391389] env[65080]: INFO networking_nsxv3.common.synchronization [None req-966e827c-2f77-4bc9-8db9-c9d98177aa6a None None] Enqueued Resource ID: df9cea54-60b5-43c8-8266-8f53e66dd716 with Priority: HIGHEST for action port [ 584.391917] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9cea54-60b5-43c8-8266-8f53e66dd716 with Priority: HIGHEST for action port [ 584.392258] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-df9cea54-60b5-43c8-8266-8f53e66dd716 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.392406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df9cea54-60b5-43c8-8266-8f53e66dd716" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.392441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df9cea54-60b5-43c8-8266-8f53e66dd716" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.392675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df9cea54-60b5-43c8-8266-8f53e66dd716" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.392758] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df9cea54-60b5-43c8-8266-8f53e66dd716',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.397424] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a44237e-330d-4cc7-8026-7e723dcc641f [ 584.397424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.397424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.397424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.397424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.397424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.397424] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a44237e-330d-4cc7-8026-7e723dcc641f already deleted. [ 584.397424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a44237e-330d-4cc7-8026-7e723dcc641f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.662979] env[65080]: INFO networking_nsxv3.common.synchronization [req-cac9866c-94c3-4609-9ba7-f909d8a7732a req-f8bd5840-a787-4abe-9772-19275497ff84 tempest-DeleteServersAdminTestJSON-1263296383 tempest-DeleteServersAdminTestJSON-1263296383-project-member] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 584.663566] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 584.663879] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.664019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.664091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.664345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.664506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.664615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.664679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.664835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.664921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.665036] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.895802] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df9cea54-60b5-43c8-8266-8f53e66dd716 [ 584.895802] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.895802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.895802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.896233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.896233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.896233] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df9cea54-60b5-43c8-8266-8f53e66dd716 already deleted. [ 584.896233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df9cea54-60b5-43c8-8266-8f53e66dd716" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.168890] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.169020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.169159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.170128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.170314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.170540] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.170652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.170719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.170902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.171106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.171106] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b already deleted. [ 585.171168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.718663] env[65080]: INFO networking_nsxv3.common.synchronization [None req-53ff363c-935a-4804-803f-82941bde682b None None] Enqueued Resource ID: ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a with Priority: HIGHEST for action port [ 585.718940] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a with Priority: HIGHEST for action port [ 585.719485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.719613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.719683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.722649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.723469] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.067622] env[65080]: INFO networking_nsxv3.common.synchronization [None req-690a7793-ce67-4826-bf58-8655df4102cd None None] Enqueued Resource ID: c28e462a-1796-4abc-873e-b00a60a208e2 with Priority: HIGHEST for action port [ 586.070123] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28e462a-1796-4abc-873e-b00a60a208e2 with Priority: HIGHEST for action port [ 586.070123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c28e462a-1796-4abc-873e-b00a60a208e2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.070123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c28e462a-1796-4abc-873e-b00a60a208e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.070439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c28e462a-1796-4abc-873e-b00a60a208e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.070796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c28e462a-1796-4abc-873e-b00a60a208e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.070976] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c28e462a-1796-4abc-873e-b00a60a208e2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.130784] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.130968] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.131275] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.131418] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.131662] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.132529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.132529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.132529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.132529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.132708] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.132708] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.132774] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.132875] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.132984] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.133107] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.133234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.153771] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.153937] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.154088] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.154265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.154608] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-185ab627-fa3e-46d8-b668-d981671fd468 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.154807] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.154894] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.155866] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.156105] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('185ab627-fa3e-46d8-b668-d981671fd468',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.225959] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a [ 586.225959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.226077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.226114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.226357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.226474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.226585] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a already deleted. [ 586.226822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccfe2bd1-9ba6-4e45-8272-e21cea0bb84a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.573600] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c28e462a-1796-4abc-873e-b00a60a208e2 [ 586.573828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.573967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.574053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.574265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.574371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.574480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c28e462a-1796-4abc-873e-b00a60a208e2 already deleted. [ 586.574566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c28e462a-1796-4abc-873e-b00a60a208e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.658996] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.659229] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.659345] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.659873] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.660054] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.660212] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 185ab627-fa3e-46d8-b668-d981671fd468 not found, creating... [ 586.660481] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.660630] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.661075] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.661075] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.661170] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.661462] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.661608] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.661716] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.661910] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.665208] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 185ab627-fa3e-46d8-b668-d981671fd468 is going to be created. [ 586.694900] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.695135] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.695245] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.695519] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.695912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.695982] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.783240] env[65080]: INFO networking_nsxv3.common.synchronization [req-9fe19ba5-0daf-4df1-bf7c-e8466e8a7a89 req-2e00d5b8-a949-45a0-baf9-20772db5cd67 tempest-ServerDiagnosticsTest-76239839 tempest-ServerDiagnosticsTest-76239839-project-member] Enqueued Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 586.783240] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 586.783240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.783240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.783240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.785811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.786598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.786598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.786598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.786762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.786832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.786950] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.249012] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.249283] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.249422] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.249704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.250698] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.250875] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.250993] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.251330] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.251486] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.251661] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.251799] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.251908] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.252106] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.252242] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.252353] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.252481] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.270711] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.270872] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.271015] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.271198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.272197] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.272197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.272197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.272197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.272472] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.289981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.290199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.290258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.290962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.291097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.291385] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.291527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.291585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.291729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.291809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.291895] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 already deleted. [ 587.292069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [req-cac9866c-94c3-4609-9ba7-f909d8a7732a req-26144f36-3320-4fdf-9b40-ffd0ec9cb917 service nova] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_rules [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [req-cac9866c-94c3-4609-9ba7-f909d8a7732a req-26144f36-3320-4fdf-9b40-ffd0ec9cb917 service nova] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [req-cac9866c-94c3-4609-9ba7-f909d8a7732a req-26144f36-3320-4fdf-9b40-ffd0ec9cb917 service nova] Enqueued Resource ID: 185ab627-fa3e-46d8-b668-d981671fd468 with Priority: HIGHEST for action port [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_rules [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 587.445512] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185ab627-fa3e-46d8-b668-d981671fd468 with Priority: HIGHEST for action port [ 587.445512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.445512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.445512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.445837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.445837] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.446941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.447088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.447198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.447329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.447472] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.447569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.447634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.447782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.447869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.447959] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.449375] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-185ab627-fa3e-46d8-b668-d981671fd468 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.449375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.449375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.449375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.449578] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('185ab627-fa3e-46d8-b668-d981671fd468',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.712531] env[65080]: INFO networking_nsxv3.common.synchronization [None req-ff85c4e3-48b0-42ea-b496-35b05a6df794 None None] Enqueued Resource ID: 2f2290d0-ea34-494e-af9e-a86fed10be7a with Priority: HIGHEST for action port [ 587.712870] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f2290d0-ea34-494e-af9e-a86fed10be7a with Priority: HIGHEST for action port [ 587.713197] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f2290d0-ea34-494e-af9e-a86fed10be7a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.713347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f2290d0-ea34-494e-af9e-a86fed10be7a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.713394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f2290d0-ea34-494e-af9e-a86fed10be7a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.713811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f2290d0-ea34-494e-af9e-a86fed10be7a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.713940] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f2290d0-ea34-494e-af9e-a86fed10be7a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.775111] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.775513] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.775657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.775940] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.776122] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.776281] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 not found, creating... [ 587.776544] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.776701] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.776870] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.777140] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.777286] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.777580] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.777731] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.777841] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.778216] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.778404] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.778576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 is going to be created. [ 587.799347] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.800089] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.800089] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.800415] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.800646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.800903] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.951801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.951957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.966325] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.966951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 185ab627-fa3e-46d8-b668-d981671fd468 with status ACTIVE [ 587.967223] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.967350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.967591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.967591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.967662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.967826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.967944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.968011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.968182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.968263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.968723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.968723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.968723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.968723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.969016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.969016] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 185ab627-fa3e-46d8-b668-d981671fd468 is going to be updated. [ 587.993052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.993052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.993052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.993387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.993387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.993552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-185ab627-fa3e-46d8-b668-d981671fd468" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.216426] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f2290d0-ea34-494e-af9e-a86fed10be7a [ 588.217538] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.217538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.217538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.217538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.217538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.217538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f2290d0-ea34-494e-af9e-a86fed10be7a already deleted. [ 588.217538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f2290d0-ea34-494e-af9e-a86fed10be7a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.345133] env[65080]: INFO networking_nsxv3.common.synchronization [req-1dd81ba8-ec95-44de-bdb2-e052f4771e29 req-a2f434de-1cc0-4406-a6f6-8d27ba7c0ac0 tempest-TenantUsagesTestJSON-489485943 tempest-TenantUsagesTestJSON-489485943-project-member] Enqueued Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 588.345191] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 588.345511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.345636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.345696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.345938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.347631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.347631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.347631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.347631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.347631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.347631] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.472803] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.578897] env[65080]: INFO networking_nsxv3.common.synchronization [req-9fe19ba5-0daf-4df1-bf7c-e8466e8a7a89 req-5f659fc1-efcd-49c5-b0cb-30a5e549f7e3 service nova] Enqueued Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_rules [ 588.579088] env[65080]: INFO networking_nsxv3.common.synchronization [req-9fe19ba5-0daf-4df1-bf7c-e8466e8a7a89 req-5f659fc1-efcd-49c5-b0cb-30a5e549f7e3 service nova] Enqueued Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 588.579224] env[65080]: INFO networking_nsxv3.common.synchronization [req-9fe19ba5-0daf-4df1-bf7c-e8466e8a7a89 req-5f659fc1-efcd-49c5-b0cb-30a5e549f7e3 service nova] Enqueued Resource ID: a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 with Priority: HIGHEST for action port [ 588.579827] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_rules [ 588.580078] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 588.580290] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 with Priority: HIGHEST for action port [ 588.580779] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.581164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.581164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.581593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.581716] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.583530] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.583669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.583763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.583917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.585120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.585120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.585120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.585120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.585120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.585120] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.586853] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.589926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.590067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.590255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.590339] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.770576] env[65080]: INFO networking_nsxv3.common.synchronization [None req-78165978-be0a-481f-a51f-4fabb1e74207 tempest-ServerActionsV293TestJSON-2025792179 tempest-ServerActionsV293TestJSON-2025792179-project-member] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 588.771071] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 588.771375] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.771500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.771566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.772396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.772396] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.849064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.849414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.849414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.849525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.849614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.849809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.849908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.849960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.850133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.850208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.850296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec already deleted. [ 588.850369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.858575] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.858746] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.858862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.859104] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.859346] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.859494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.859603] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.859804] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.859937] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.860150] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.860988] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.860988] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.860988] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.860988] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.860988] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.860988] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.878933] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.879109] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.879245] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.879435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.879709] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-e9cb8d4c-83a7-42c4-be63-b22928149913 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.879876] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.880226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.880515] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.880649] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9cb8d4c-83a7-42c4-be63-b22928149913',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.976175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.976391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.976391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.976606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.976695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.976794] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be created. [ 589.047994] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.048204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.048291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.048607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.048801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.059007] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: UNINITIALIZED for 2s [ 589.092730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.092868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.093154] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.094040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 with status ACTIVE [ 589.094225] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.094341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.094428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.094638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.094724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.094897] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.094994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.095072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.097650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.097864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.097957] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.098059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.098118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.098281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.098358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.098446] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9 is going to be updated. [ 589.125679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.125679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.125679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.125679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.125925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.125970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1d3fc2e-fa10-4ee7-8544-e71b151b9eb9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.300690] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.300929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.300929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.301122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.301214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.301313] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a already deleted. [ 589.301398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.382852] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.383241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.383322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.383588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.383737] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.383887] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port e9cb8d4c-83a7-42c4-be63-b22928149913 not found, creating... [ 589.384159] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.384327] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.384473] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.384653] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.384786] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.385080] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.385226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.385336] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.385534] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.385660] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.385792] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: e9cb8d4c-83a7-42c4-be63-b22928149913 is going to be created. [ 589.395520] env[65080]: INFO networking_nsxv3.common.synchronization [None req-80743067-e967-4457-ae04-f8a0c4f36c8a tempest-ServerActionsV293TestJSON-2025792179 tempest-ServerActionsV293TestJSON-2025792179-project-member] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 589.396065] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 589.396394] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.396548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.396705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.396864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.397176] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.405362] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.405362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.405362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.405738] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.405999] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.406501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.600384] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.919572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.919572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.919572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.919572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.919572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.919572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a already deleted. [ 589.919572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.103926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.104152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.104233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.104439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.104530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.104687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 is going to be created. [ 590.119752] env[65080]: INFO networking_nsxv3.common.synchronization [req-1dd81ba8-ec95-44de-bdb2-e052f4771e29 req-93520d25-b44d-4eac-8d85-7c316fdefa24 service nova] Enqueued Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_rules [ 590.119902] env[65080]: INFO networking_nsxv3.common.synchronization [req-1dd81ba8-ec95-44de-bdb2-e052f4771e29 req-93520d25-b44d-4eac-8d85-7c316fdefa24 service nova] Enqueued Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 590.120067] env[65080]: INFO networking_nsxv3.common.synchronization [req-1dd81ba8-ec95-44de-bdb2-e052f4771e29 req-93520d25-b44d-4eac-8d85-7c316fdefa24 service nova] Enqueued Resource ID: e9cb8d4c-83a7-42c4-be63-b22928149913 with Priority: HIGHEST for action port [ 590.120311] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_rules [ 590.120441] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 590.120537] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cb8d4c-83a7-42c4-be63-b22928149913 with Priority: HIGHEST for action port [ 590.121095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.121224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.121292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.121868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.121954] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.123091] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.123233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.123355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.123543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.123752] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.123844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.123909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.124063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.124154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.124287] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.125435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9cb8d4c-83a7-42c4-be63-b22928149913 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.125560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.125560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.125700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.125756] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9cb8d4c-83a7-42c4-be63-b22928149913',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.127757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.127873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.127927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.132143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.132963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.141513] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: UNINITIALIZED for 2s [ 590.551741] env[65080]: INFO networking_nsxv3.common.synchronization [None req-61467c97-e1e5-4422-9035-6ab834cdfe95 tempest-VolumesAssistedSnapshotsTest-889949791 tempest-VolumesAssistedSnapshotsTest-889949791-project-member] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 590.552345] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 590.552636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.552811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.552864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.553125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.553229] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.627977] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.627977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.627977] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.634189] env[65080]: INFO networking_nsxv3.common.synchronization [None req-824f8638-b9ce-4fa4-be9f-b46ec63f4328 tempest-VolumesAssistedSnapshotsTest-889949791 tempest-VolumesAssistedSnapshotsTest-889949791-project-member] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 590.634486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9cb8d4c-83a7-42c4-be63-b22928149913 with status ACTIVE [ 590.634693] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.634840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.634903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.637222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.637323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.637553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.637644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.637691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.637915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.637977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.638427] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.638427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.638427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.638427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.638612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.638612] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9cb8d4c-83a7-42c4-be63-b22928149913 is going to be updated. [ 590.640279] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 590.640910] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.640997] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.665541] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.666171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.666171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.666171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.666171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.666487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9cb8d4c-83a7-42c4-be63-b22928149913" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.020156] env[65080]: INFO networking_nsxv3.common.synchronization [None req-fb8911b4-b944-4fea-88e2-c1271c6a719b tempest-ServersTestManualDisk-2013964951 tempest-ServersTestManualDisk-2013964951-project-member] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 591.020749] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 591.022616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.022616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.022616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.023979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.023979] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.080364] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 591.080960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.081201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.081460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.081716] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.081875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.081965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.082197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.082863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.082863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.082863] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.085071] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.085071] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f already deleted. [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.085071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.085422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.085464] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.132781] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.185982] env[65080]: INFO networking_nsxv3.common.synchronization [None req-2dc21a84-6aff-418d-8cba-5e34b2d8f435 tempest-ServersTestManualDisk-2013964951 tempest-ServersTestManualDisk-2013964951-project-member] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 591.185982] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 591.186642] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.186642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.547117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.547263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.547991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.547991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.547991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.547991] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 already deleted. [ 591.547991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.547991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.548246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.548246] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.589933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.590139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.590199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.590457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.590633] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.590747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.591518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.591518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.591861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.591861] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.591939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.592041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.592271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.592363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.592481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.592619] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.613439] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.613583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.613692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.613873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.613964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.614107] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f already deleted. [ 591.614160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.635075] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.635242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.635285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.635732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.635732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.635732] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec is going to be created. [ 591.659325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.659325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.659325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.659514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.659619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.670264] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: UNINITIALIZED for 2s [ 592.069685] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.069983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.069983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.070131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.070224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.070318] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 already deleted. [ 592.070400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.096176] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5db4dff-67d7-4cc9-a39d-74b1615f620b: rpc.has_security_group_logging(os_id): False [ 592.117192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.117192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.117192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.117192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.117757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.117757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.117757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.117757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.117757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.117757] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be created. [ 592.152797] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: SUCCESS [ 592.153037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.153212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.153411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153595] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.153711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.153774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.153918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.154089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.154173] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.186948] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.187116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.187188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.187389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.187564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.200084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 592.323426] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c7a7ae0-2e76-4a43-8589-a767af25682d req-af967cd4-3a0a-41a6-9c02-5ffa8377287c tempest-ServerExternalEventsTest-953929413 tempest-ServerExternalEventsTest-953929413-project-member] Enqueued Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 592.324568] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 592.325220] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.325414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.325556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.326094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.326305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.326567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.326567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.326946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.327238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.327431] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.657497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.657739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.657739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.659986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.659986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.659986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.659986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.659986] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.728415] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.728617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.728734] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.728990] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.729255] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.729413] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.729527] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.729734] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.729872] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.730272] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.730375] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.730513] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.730649] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.730802] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.730934] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.731107] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.755280] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.755280] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.755280] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.755280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.755280] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-8529df81-a14e-4ed4-853c-d27898e2a6a1 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.755280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.755280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.755280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.755280] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8529df81-a14e-4ed4-853c-d27898e2a6a1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.831927] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.832153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.832402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.832511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.832511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.832865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.832865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.832865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.833369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.833369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.833369] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 already deleted. [ 592.833369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.165470] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7235a15a-5182-42b0-892c-541ba160fba3: rpc.has_security_group_logging(os_id): False [ 593.186132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.186132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.186132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.186132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.187049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.187319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.187845] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.188107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.188299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.188545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.188717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.188919] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 is going to be created. [ 593.253315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.253475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.253548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.253753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.253933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.257738] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.257942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.258077] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.258336] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.258479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.258639] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 8529df81-a14e-4ed4-853c-d27898e2a6a1 not found, creating... [ 593.258879] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.259064] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.259188] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.259402] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.259533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.259808] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.259950] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.260099] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.260307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.260428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.260558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 8529df81-a14e-4ed4-853c-d27898e2a6a1 is going to be created. [ 593.267843] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: IN_PROGRESS for 2s [ 593.285718] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.286022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.286201] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.286442] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.286662] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.287041] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.680886] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: SUCCESS [ 593.681154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.681330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.681572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.681765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.681878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.681945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.682187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.682278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.682372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.682508] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.006145] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c7a7ae0-2e76-4a43-8589-a767af25682d req-dc0567ba-2ea8-44eb-b9c3-93d392f34e8c service nova] Enqueued Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_rules [ 594.006446] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c7a7ae0-2e76-4a43-8589-a767af25682d req-dc0567ba-2ea8-44eb-b9c3-93d392f34e8c service nova] Enqueued Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 594.006505] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c7a7ae0-2e76-4a43-8589-a767af25682d req-dc0567ba-2ea8-44eb-b9c3-93d392f34e8c service nova] Enqueued Resource ID: 8529df81-a14e-4ed4-853c-d27898e2a6a1 with Priority: HIGHEST for action port [ 594.006974] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_rules [ 594.007129] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 594.007235] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8529df81-a14e-4ed4-853c-d27898e2a6a1 with Priority: HIGHEST for action port [ 594.007504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.007733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.007817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.008167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.008214] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.009025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.009157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.009230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.009445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.009535] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.009645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.009717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.009862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.009945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.010066] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.010776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8529df81-a14e-4ed4-853c-d27898e2a6a1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.010885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.010951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.011336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.011415] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8529df81-a14e-4ed4-853c-d27898e2a6a1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.185131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.185423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.185423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.185604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.185773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.185903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.185974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.186196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.186291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.186381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.186536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.186641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.186734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.186886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.187085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.187201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.187285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.187409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.187487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.187570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.187658] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.210925] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 594.211201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.513237] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.513565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.514908] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.515918] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8529df81-a14e-4ed4-853c-d27898e2a6a1 with status ACTIVE [ 594.516137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.516266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.516344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.516586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.516659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.516839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.516936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.516993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.517159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.517259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.517666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.517666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.517666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.517800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.519368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.519511] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8529df81-a14e-4ed4-853c-d27898e2a6a1 is going to be updated. [ 594.544248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.544248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.544248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.544248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.544248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.544248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8529df81-a14e-4ed4-853c-d27898e2a6a1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.690491] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b62ed3e-e617-4e8b-af7c-ff034e19bbec: rpc.has_security_group_logging(os_id): False [ 594.710159] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.710357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.710459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.710698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.710790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.711041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.711186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.711278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.711484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.711569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.712470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.712470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.712470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.712470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.712470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.712470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.712800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.712800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.712955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.712990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.713089] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec is going to be created. [ 594.784839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.784924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.785168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.785237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.785409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.801667] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: IN_PROGRESS for 2s [ 595.021889] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.281707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: SUCCESS [ 595.282068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.528023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.528023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.528023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.528023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.528023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.528023] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 is going to be created. [ 595.554471] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.555101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.556586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.556586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.556586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.569994] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: UNINITIALIZED for 2s [ 596.818711] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: SUCCESS [ 596.819661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.000728] env[65080]: INFO networking_nsxv3.common.synchronization [None req-48db582d-6446-43e5-979e-af3aa50ff718 None None] Enqueued Resource ID: 8978ba49-4dbe-455b-9efc-e98abb40c701 with Priority: HIGHEST for action port [ 597.001401] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8978ba49-4dbe-455b-9efc-e98abb40c701 with Priority: HIGHEST for action port [ 597.001714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8978ba49-4dbe-455b-9efc-e98abb40c701 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.001841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8978ba49-4dbe-455b-9efc-e98abb40c701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.001908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8978ba49-4dbe-455b-9efc-e98abb40c701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.003030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8978ba49-4dbe-455b-9efc-e98abb40c701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.003030] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8978ba49-4dbe-455b-9efc-e98abb40c701',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.505497] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8978ba49-4dbe-455b-9efc-e98abb40c701 [ 597.505730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.505884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.506040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.506195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.506285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.506381] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8978ba49-4dbe-455b-9efc-e98abb40c701 already deleted. [ 597.506457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8978ba49-4dbe-455b-9efc-e98abb40c701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.583686] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: SUCCESS [ 597.583686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.583860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.584047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.584255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.584372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.584439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.584662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.584703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.584784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.584875] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.087186] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.087633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.087633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.087633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.088702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.088702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.088702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.089018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.089018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.089073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.089176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.089288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.089377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.089458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.089544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.089712] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.592263] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dc61faf-26f7-4161-a835-ebac2e25ee27: rpc.has_security_group_logging(os_id): False [ 598.618922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.618922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.618922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.619192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.619313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.619559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.619707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.619707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.620377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.620460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.620712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.620827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.620891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.621068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.621147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.621347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.621468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.621680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.621680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.621816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.621878] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 is going to be created. [ 598.691770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.692502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.696276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.697333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.697333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.712347] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: IN_PROGRESS for 2s [ 599.407960] env[65080]: INFO networking_nsxv3.common.synchronization [None req-2aa6ea50-e117-4644-9338-b6f7f86a5a09 None None] Enqueued Resource ID: a40cda35-d16a-41f5-b512-075924665cbe with Priority: HIGHEST for action port [ 599.409475] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40cda35-d16a-41f5-b512-075924665cbe with Priority: HIGHEST for action port [ 599.409962] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a40cda35-d16a-41f5-b512-075924665cbe taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.410243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a40cda35-d16a-41f5-b512-075924665cbe" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.410243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a40cda35-d16a-41f5-b512-075924665cbe" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.410525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a40cda35-d16a-41f5-b512-075924665cbe" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.410675] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a40cda35-d16a-41f5-b512-075924665cbe',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.478723] env[65080]: INFO networking_nsxv3.common.synchronization [None req-af0d54a7-cc0a-4035-9ad7-d46b36e5c41a None None] Enqueued Resource ID: cd363820-19b3-48dd-adc1-1a53caf86884 with Priority: HIGHEST for action port [ 599.479329] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd363820-19b3-48dd-adc1-1a53caf86884 with Priority: HIGHEST for action port [ 599.479791] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd363820-19b3-48dd-adc1-1a53caf86884 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.481792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd363820-19b3-48dd-adc1-1a53caf86884" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.481792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd363820-19b3-48dd-adc1-1a53caf86884" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.481792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd363820-19b3-48dd-adc1-1a53caf86884" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.481792] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd363820-19b3-48dd-adc1-1a53caf86884',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.914642] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a40cda35-d16a-41f5-b512-075924665cbe [ 599.914823] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.914916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.914971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.915516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.915516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.915516] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a40cda35-d16a-41f5-b512-075924665cbe already deleted. [ 599.915516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a40cda35-d16a-41f5-b512-075924665cbe" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.983255] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd363820-19b3-48dd-adc1-1a53caf86884 [ 599.983255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.983255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.983255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.983255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.983255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.983255] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd363820-19b3-48dd-adc1-1a53caf86884 already deleted. [ 599.983484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd363820-19b3-48dd-adc1-1a53caf86884" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.984408] env[65080]: INFO networking_nsxv3.common.synchronization [req-37fa1963-e5ff-4b48-bb7d-53e70b6f141a req-35942dcb-ed55-43fc-bbaa-92e03f928bea tempest-VolumesAssistedSnapshotsTest-889949791 tempest-VolumesAssistedSnapshotsTest-889949791-project-member] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 599.984921] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 599.985286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.985547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.985547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.985673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.985832] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.985917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.985951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.986232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.986232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.986368] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.448466] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.448466] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-947" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.448466] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-947" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.451476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-947" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.451476] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.451476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.451862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.452239] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.452419] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.452678] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.454282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.454282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.454282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.454282] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.454282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.454282] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.477480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.478765] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.478765] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.478765] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-947" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.479522] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c0534420-85e5-4313-b575-a214673e08b8 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.479522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.479522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.479761] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.480064] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0534420-85e5-4313-b575-a214673e08b8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.490225] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.490225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.490225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.490225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.490225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.490559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.490700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.490765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.490949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.491038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.491130] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f already deleted. [ 600.491211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.725663] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: SUCCESS [ 600.725788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.983269] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.983378] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.983998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.983998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.983998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.984339] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c0534420-85e5-4313-b575-a214673e08b8 not found, creating... [ 600.984460] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.984641] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.984807] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.985287] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.985471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.985789] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.985976] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.986132] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.986388] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.986522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.986687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c0534420-85e5-4313-b575-a214673e08b8 is going to be created. [ 601.010718] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.010919] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.011040] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.011355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.011591] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.011814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.735122] env[65080]: INFO networking_nsxv3.common.synchronization [req-37fa1963-e5ff-4b48-bb7d-53e70b6f141a req-a967d4fd-76d6-4312-8dde-a7a53a6ea8ec service nova] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 601.735380] env[65080]: INFO networking_nsxv3.common.synchronization [req-37fa1963-e5ff-4b48-bb7d-53e70b6f141a req-a967d4fd-76d6-4312-8dde-a7a53a6ea8ec service nova] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 601.735466] env[65080]: INFO networking_nsxv3.common.synchronization [req-37fa1963-e5ff-4b48-bb7d-53e70b6f141a req-a967d4fd-76d6-4312-8dde-a7a53a6ea8ec service nova] Enqueued Resource ID: c0534420-85e5-4313-b575-a214673e08b8 with Priority: HIGHEST for action port [ 601.736008] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_rules [ 601.736263] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 601.736722] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0534420-85e5-4313-b575-a214673e08b8 with Priority: HIGHEST for action port [ 601.736981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.737114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.737178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.737373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.737454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.738289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.738935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.738935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.738935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.738935] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.738935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.738935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.739258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.739258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.739258] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.739925] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0534420-85e5-4313-b575-a214673e08b8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.741192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.741192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.741192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.741192] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0534420-85e5-4313-b575-a214673e08b8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.038855] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b57b9069-edbc-41d7-b1d0-7c59b40ea169 None None] Enqueued Resource ID: 43f85ef3-a475-473d-bf81-31fe459a0834 with Priority: HIGHEST for action port [ 602.039421] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43f85ef3-a475-473d-bf81-31fe459a0834 with Priority: HIGHEST for action port [ 602.039826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-43f85ef3-a475-473d-bf81-31fe459a0834 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.039944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43f85ef3-a475-473d-bf81-31fe459a0834" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.039944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43f85ef3-a475-473d-bf81-31fe459a0834" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.042254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43f85ef3-a475-473d-bf81-31fe459a0834" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.042254] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43f85ef3-a475-473d-bf81-31fe459a0834',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.129918] env[65080]: INFO networking_nsxv3.common.synchronization [None req-cf9e5713-7337-4c74-85df-3334a1c878e3 None None] Enqueued Resource ID: d58d15e9-8734-4944-a7d3-b2ea01e116dd with Priority: HIGHEST for action port [ 602.129918] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58d15e9-8734-4944-a7d3-b2ea01e116dd with Priority: HIGHEST for action port [ 602.130714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d58d15e9-8734-4944-a7d3-b2ea01e116dd taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.130714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d58d15e9-8734-4944-a7d3-b2ea01e116dd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.130714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d58d15e9-8734-4944-a7d3-b2ea01e116dd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.130918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d58d15e9-8734-4944-a7d3-b2ea01e116dd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.130918] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d58d15e9-8734-4944-a7d3-b2ea01e116dd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.242774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.242950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.249279] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0534420-85e5-4313-b575-a214673e08b8 with status ACTIVE [ 602.249538] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.249743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.249823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.250167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.250167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.250359] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.250433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.250481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.250642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.250722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.250905] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.250999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.251077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.251221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.251362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.251395] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0534420-85e5-4313-b575-a214673e08b8 is going to be updated. [ 602.252696] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.287678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.288139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.288139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.288407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.288745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.288745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0534420-85e5-4313-b575-a214673e08b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.346189] env[65080]: INFO networking_nsxv3.common.synchronization [None req-cf8aff7e-93e0-442e-a8f7-dcf8c3888a26 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 602.347055] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 602.347176] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.347361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.347361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.347606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.347691] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.545432] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43f85ef3-a475-473d-bf81-31fe459a0834 [ 602.545740] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.545890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.545890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.546826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.546897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.547016] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43f85ef3-a475-473d-bf81-31fe459a0834 already deleted. [ 602.547115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43f85ef3-a475-473d-bf81-31fe459a0834" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.633533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d58d15e9-8734-4944-a7d3-b2ea01e116dd [ 602.633759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.633895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.633963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.634206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.634300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.634404] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d58d15e9-8734-4944-a7d3-b2ea01e116dd already deleted. [ 602.634483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d58d15e9-8734-4944-a7d3-b2ea01e116dd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.727829] env[65080]: INFO networking_nsxv3.common.synchronization [None req-335adacb-c441-4f98-bec1-cbe8e88deb71 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 602.728510] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 602.729030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.729030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.756397] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.875557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.875719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.875788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.876036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.876102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.876197] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b already deleted. [ 602.876197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.876197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.876625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.876715] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.003074] env[65080]: INFO networking_nsxv3.common.synchronization [req-a819f906-3b1e-4fac-86f3-8a87d5c7a237 req-72d8d729-3792-481e-8484-e69f69f5ade6 tempest-ServersTestManualDisk-2013964951 tempest-ServersTestManualDisk-2013964951-project-member] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 603.003074] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 603.003354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.004066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.004066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.004217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.004328] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.004479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.004572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.004756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.004865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.004975] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.260868] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.260868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.261115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.261392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.261464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.261602] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f is going to be created. [ 603.290150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.290405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.290405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.290586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.290750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.303467] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: UNINITIALIZED for 2s [ 603.400351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.400565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.400565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.401134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.401134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.401134] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b already deleted. [ 603.401134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.507091] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.507091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.507091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.507296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.507405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.507575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.507672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.507774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.507884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.507961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.508062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 already deleted. [ 603.508146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.657677] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.657677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.657677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.657677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.657890] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.657949] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.658384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.658384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.658483] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.658707] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.659486] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.659486] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.659486] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.659486] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.659486] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.659486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.684374] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.684548] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.684673] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.684819] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.685270] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-6331b29b-9e72-4744-bfa5-383ddceacd96 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.685446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.685446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.685817] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.686028] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6331b29b-9e72-4744-bfa5-383ddceacd96',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.929813] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7e649178-2338-44ce-9d12-8777d46c4070 None None] Enqueued Resource ID: 70b92598-521d-4476-ae91-b1becece844f with Priority: HIGHEST for action port [ 603.930786] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b92598-521d-4476-ae91-b1becece844f with Priority: HIGHEST for action port [ 603.930786] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-70b92598-521d-4476-ae91-b1becece844f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.930978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70b92598-521d-4476-ae91-b1becece844f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.930978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70b92598-521d-4476-ae91-b1becece844f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.931212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70b92598-521d-4476-ae91-b1becece844f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.931296] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b92598-521d-4476-ae91-b1becece844f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.190297] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.190297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.190297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.190297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.190297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.190617] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 6331b29b-9e72-4744-bfa5-383ddceacd96 not found, creating... [ 604.190617] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.190809] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.190905] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.191099] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.191237] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.191512] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.191661] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.191851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.191972] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.192111] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.192290] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 6331b29b-9e72-4744-bfa5-383ddceacd96 is going to be created. [ 604.219434] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.219687] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.219779] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.220179] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.220508] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.220746] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.433461] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70b92598-521d-4476-ae91-b1becece844f [ 604.433848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.434073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.434197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.434861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.434861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.434861] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70b92598-521d-4476-ae91-b1becece844f already deleted. [ 604.435229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70b92598-521d-4476-ae91-b1becece844f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.024319] env[65080]: INFO networking_nsxv3.common.synchronization [req-a819f906-3b1e-4fac-86f3-8a87d5c7a237 req-d6611ac8-719d-48c9-a5e5-c9d6f02816de service nova] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 605.024684] env[65080]: INFO networking_nsxv3.common.synchronization [req-a819f906-3b1e-4fac-86f3-8a87d5c7a237 req-d6611ac8-719d-48c9-a5e5-c9d6f02816de service nova] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 605.024831] env[65080]: INFO networking_nsxv3.common.synchronization [req-a819f906-3b1e-4fac-86f3-8a87d5c7a237 req-d6611ac8-719d-48c9-a5e5-c9d6f02816de service nova] Enqueued Resource ID: 6331b29b-9e72-4744-bfa5-383ddceacd96 with Priority: HIGHEST for action port [ 605.025548] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_rules [ 605.025691] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 605.025790] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6331b29b-9e72-4744-bfa5-383ddceacd96 with Priority: HIGHEST for action port [ 605.026085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.026211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.026281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.026482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.026560] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.027909] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.028219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.028219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.028415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.028565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.028648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.028715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.028860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.028943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.029046] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.030576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6331b29b-9e72-4744-bfa5-383ddceacd96 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.030687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.030687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.030907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.030978] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6331b29b-9e72-4744-bfa5-383ddceacd96',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.099179] env[65080]: INFO networking_nsxv3.common.synchronization [None req-938b4736-892d-46ca-9ef4-e73ce1f719d6 tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 605.099704] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 605.100017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.100169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.100339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.100528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.100606] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.205941] env[65080]: INFO networking_nsxv3.common.synchronization [None req-408dcdb1-03aa-4d9c-aec1-f343e11f3985 tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 605.209079] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 605.209459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.210186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.320053] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: SUCCESS [ 605.320303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.320539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.322295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.322295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.322295] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.528852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.528852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.531482] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.533049] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6331b29b-9e72-4744-bfa5-383ddceacd96 with status ACTIVE [ 605.535101] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.535101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.535101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.539036] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.539036] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.539036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.539036] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6331b29b-9e72-4744-bfa5-383ddceacd96 is going to be updated. [ 605.567267] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.567267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.568100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.568100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.568587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.569284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6331b29b-9e72-4744-bfa5-383ddceacd96" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.622226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.622445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.622523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.622742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.622846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.622942] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 already deleted. [ 605.623037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623802] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.825061] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.042597] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.147149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.148325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.150335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.150586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.150685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.150789] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 already deleted. [ 606.150871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.329281] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e59560e-07cb-4010-9db4-01e08b7a2a6f: rpc.has_security_group_logging(os_id): False [ 606.349425] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.349578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.349650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.349903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.350041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.350601] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.350737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.350805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.350985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.351600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.351764] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f is going to be created. [ 606.423029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.423029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.423029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.423029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.423029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.434946] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: IN_PROGRESS for 2s [ 606.546076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.546347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.546347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.546578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.546732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.546732] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 is going to be created. [ 606.574023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.574023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.574023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.574023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.574023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.586701] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: UNINITIALIZED for 2s [ 606.964598] env[65080]: INFO networking_nsxv3.common.synchronization [req-794fffc8-4090-456d-93a4-e582f515564d req-c67e60c2-5fc5-4075-8c4c-1fcdc19536aa tempest-SecurityGroupRulesNegativeTestJSON-1994631770 tempest-SecurityGroupRulesNegativeTestJSON-1994631770-project-member] Enqueued Resource ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 with Priority: HIGHEST for action security_group_rules [ 606.965343] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 with Priority: HIGHEST for action security_group_rules [ 606.965578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.966089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.966174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.966447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.966600] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.488572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.488885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.488885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.488951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.489087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.489151] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 already deleted. [ 607.489238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.447737] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: SUCCESS [ 608.447970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.601650] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: SUCCESS [ 608.602032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.602128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.602389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.602599] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.602736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.602822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.602993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.603108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.604897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.604897] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.105456] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.609984] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f37e842d-6cd4-418f-bbf9-d080ba3516d1: rpc.has_security_group_logging(os_id): False [ 609.634157] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.635035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.637085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.637085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.637085] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 is going to be created. [ 609.720183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.720389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.720466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.720705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.720921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.742949] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: IN_PROGRESS for 2s [ 610.247393] env[65080]: INFO networking_nsxv3.common.synchronization [req-8ae3e1b4-9056-4a1d-a43b-327a504105e0 req-7da6331a-a1f0-414e-86ff-0552144b7ab6 tempest-DeleteServersAdminTestJSON-335094053 tempest-DeleteServersAdminTestJSON-335094053-project-admin] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 610.247914] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 610.248243] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.248358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.248423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.248615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.248759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.249152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.249221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.249489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.249489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.249616] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.758822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.759273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.759273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.759273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.759273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.759622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.759622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.759622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.760905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.761009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.761178] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be updated. [ 610.809332] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.809466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.809466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.809625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.809763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.819494] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 611.198026] env[65080]: INFO networking_nsxv3.common.synchronization [req-f9f65364-9bc5-4ca8-96bd-abb384edbb40 req-3551c8ca-20ed-495c-9867-6317aeac61ad tempest-ServerDiagnosticsTest-76239839 tempest-ServerDiagnosticsTest-76239839-project-member] Enqueued Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 611.198597] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGHEST for action security_group_members [ 611.198807] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.198976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.200442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.200668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.200841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.201187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.201291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.201474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.201563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.201760] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.705014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.705202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.705288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.705495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.708527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.708527] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.708527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.708527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.708527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.708527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.708527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 is going to be updated. [ 611.735256] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.735411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.735468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.735861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.735861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.745246] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: IN_PROGRESS for 2s [ 611.752924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: SUCCESS [ 611.753325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.816618] env[65080]: INFO networking_nsxv3.common.synchronization [req-68c082c5-f402-42a3-b4e6-f647c4dd3363 req-7a01c166-fd2f-432b-bbd8-b4921457bdb3 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 612.816977] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 612.817533] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.817658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.817736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.818011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.819517] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.819517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.820262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.820262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.820262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.820531] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.833557] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 612.834121] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b deletion is rescheduled due to dependency. [ 612.834226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.324714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.324892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.324962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.325325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.325425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.325971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.326098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.326164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.326327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.326430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.326520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b already deleted. [ 613.326602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.480649] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.481222] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-603" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.481222] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-603" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.481343] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-603" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.481568] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.481727] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.481836] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.482061] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.482318] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.482458] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.482570] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.482672] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.482773] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.482879] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.482976] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.483117] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.502122] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.502289] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.502489] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.502664] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-603" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.502983] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-113fee7a-0fc9-4456-9438-2239d32409c7 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.503226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.503277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.503922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.504084] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113fee7a-0fc9-4456-9438-2239d32409c7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.755894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7235a15a-5182-42b0-892c-541ba160fba3 in Status: SUCCESS [ 613.756109] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 deletion is rescheduled due to dependency. [ 613.756245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.991238] env[65080]: INFO networking_nsxv3.common.synchronization [req-f779354d-c502-478f-b180-2e40ef3e8b50 req-b0b22373-27b4-4b96-8fb1-06c829944d2a tempest-SecurityGroupRulesNegativeTestJSON-1994631770 tempest-SecurityGroupRulesNegativeTestJSON-1994631770-project-member] Enqueued Resource ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 with Priority: HIGHEST for action security_group_rules [ 613.992694] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 with Priority: HIGHEST for action security_group_rules [ 613.992694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.992694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.992886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.992970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.993062] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.006653] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.006956] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.007134] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.007435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.007585] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.007739] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 113fee7a-0fc9-4456-9438-2239d32409c7 not found, creating... [ 614.008038] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.008174] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.008300] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.008523] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.008655] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.008993] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.009237] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.009289] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.009510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.009648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.009815] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 113fee7a-0fc9-4456-9438-2239d32409c7 is going to be created. [ 614.030559] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.030755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.030886] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.031165] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.031423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.031592] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.091986] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9821c0ab-dbe4-4132-a2e3-2aa839b2c42b None None] Enqueued Resource ID: 32fef145-c6c2-4590-b3ba-0f938f7ce1ed with Priority: HIGHEST for action port [ 614.092626] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fef145-c6c2-4590-b3ba-0f938f7ce1ed with Priority: HIGHEST for action port [ 614.093074] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-32fef145-c6c2-4590-b3ba-0f938f7ce1ed taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.093261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32fef145-c6c2-4590-b3ba-0f938f7ce1ed" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.093385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32fef145-c6c2-4590-b3ba-0f938f7ce1ed" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.093825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32fef145-c6c2-4590-b3ba-0f938f7ce1ed" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.093952] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32fef145-c6c2-4590-b3ba-0f938f7ce1ed',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.515207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.515370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.515466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.515748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.515851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.515954] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0 already deleted. [ 614.516050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f87e02d-d7fa-45d4-a0b5-22bc06f8ccd0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.597493] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32fef145-c6c2-4590-b3ba-0f938f7ce1ed [ 614.598160] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.598160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.598160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.598507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.598699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.598961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32fef145-c6c2-4590-b3ba-0f938f7ce1ed already deleted. [ 614.599215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32fef145-c6c2-4590-b3ba-0f938f7ce1ed" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.807541] env[65080]: INFO networking_nsxv3.common.synchronization [req-68c082c5-f402-42a3-b4e6-f647c4dd3363 req-f8ae5f87-2936-4218-8b7b-40afe121c0dc service nova] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 614.807636] env[65080]: INFO networking_nsxv3.common.synchronization [req-68c082c5-f402-42a3-b4e6-f647c4dd3363 req-f8ae5f87-2936-4218-8b7b-40afe121c0dc service nova] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 614.807764] env[65080]: INFO networking_nsxv3.common.synchronization [req-68c082c5-f402-42a3-b4e6-f647c4dd3363 req-f8ae5f87-2936-4218-8b7b-40afe121c0dc service nova] Enqueued Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 614.808311] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 614.808458] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 614.808552] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 614.809019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.809211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.809297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.809532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.809692] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.810536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.810806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.810806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.810927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.811092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.811189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.811251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.811402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.811488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.811579] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.812594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-113fee7a-0fc9-4456-9438-2239d32409c7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.812734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.812822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.813014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.813120] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113fee7a-0fc9-4456-9438-2239d32409c7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.317829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.317829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.318265] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.318883] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 113fee7a-0fc9-4456-9438-2239d32409c7 with status ACTIVE [ 615.319096] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.319223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.319280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.319492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.319628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.319756] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.319850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.319907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.320305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.320305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.320305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.320504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.320504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.320605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.320664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.320716] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 113fee7a-0fc9-4456-9438-2239d32409c7 is going to be updated. [ 615.330225] env[65080]: INFO networking_nsxv3.common.synchronization [req-f023493a-48bb-4410-8583-d3bbdf07fa59 req-3697f68d-ff76-422c-a245-93d2174240ac tempest-ServerExternalEventsTest-953929413 tempest-ServerExternalEventsTest-953929413-project-member] Enqueued Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 615.331171] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGHEST for action security_group_members [ 615.331402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.331533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.331640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.331924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.332170] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.332374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.332447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.332649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.332742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.332840] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.345332] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.345537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.345537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.345645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.345983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.346163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.825208] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.837182] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.837264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.837302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.837498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.837727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.837894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.838012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.838012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.838373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.838373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.838373] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 is going to be updated. [ 615.876109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.876109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.876109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.876109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.876109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.888046] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: IN_PROGRESS for 2s [ 616.142747] env[65080]: INFO networking_nsxv3.common.synchronization [None req-cd694e3e-10e7-42f6-be64-d74153e000f0 None None] Enqueued Resource ID: 30ad5551-7d69-4f36-901c-1118c6b46668 with Priority: HIGHEST for action port [ 616.143345] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ad5551-7d69-4f36-901c-1118c6b46668 with Priority: HIGHEST for action port [ 616.146820] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-30ad5551-7d69-4f36-901c-1118c6b46668 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.147241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30ad5551-7d69-4f36-901c-1118c6b46668" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.147666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30ad5551-7d69-4f36-901c-1118c6b46668" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.148666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30ad5551-7d69-4f36-901c-1118c6b46668" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.148833] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30ad5551-7d69-4f36-901c-1118c6b46668',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.332123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.332484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.332484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.334472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.334627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.334707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be created. [ 616.362179] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.362278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.362278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.362572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.362737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.375490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: UNINITIALIZED for 2s [ 616.478632] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a778f6-7aae-48bf-8dd0-db277e0185d6 req-e65d575c-7edb-4136-8641-67485b5a218a tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 616.479753] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 616.480130] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.480304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.481352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.481352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.481352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.481352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.481813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.482755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.482755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.482755] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.651308] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30ad5551-7d69-4f36-901c-1118c6b46668 [ 616.651541] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.651678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.651748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.651962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.652066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.652162] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30ad5551-7d69-4f36-901c-1118c6b46668 already deleted. [ 616.652243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30ad5551-7d69-4f36-901c-1118c6b46668" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.743999] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d7121ae4-7caf-4c19-86c1-4dd65313f68b None None] Enqueued Resource ID: fb74d98f-2cb0-450b-b744-087bb028d3d1 with Priority: HIGHEST for action port [ 616.744529] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb74d98f-2cb0-450b-b744-087bb028d3d1 with Priority: HIGHEST for action port [ 616.744830] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb74d98f-2cb0-450b-b744-087bb028d3d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.744944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb74d98f-2cb0-450b-b744-087bb028d3d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.745016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb74d98f-2cb0-450b-b744-087bb028d3d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.745444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb74d98f-2cb0-450b-b744-087bb028d3d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.746551] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb74d98f-2cb0-450b-b744-087bb028d3d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.984589] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.984764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.984830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.985106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.985202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.985443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.985514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.985545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.985824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.985824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.985895] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 already deleted. [ 616.985924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.250583] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb74d98f-2cb0-450b-b744-087bb028d3d1 [ 617.250738] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.250957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.251167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.251262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.251818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.251818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb74d98f-2cb0-450b-b744-087bb028d3d1 already deleted. [ 617.251818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb74d98f-2cb0-450b-b744-087bb028d3d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.725430] env[65080]: INFO networking_nsxv3.common.synchronization [None req-08639795-393c-42b4-abd0-01b19da865c6 None None] Enqueued Resource ID: c82c8392-77ed-461b-9384-4c4146bcb778 with Priority: HIGHEST for action port [ 617.726575] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c82c8392-77ed-461b-9384-4c4146bcb778 with Priority: HIGHEST for action port [ 617.726982] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c82c8392-77ed-461b-9384-4c4146bcb778 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.727195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c82c8392-77ed-461b-9384-4c4146bcb778" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.727258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c82c8392-77ed-461b-9384-4c4146bcb778" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.727599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c82c8392-77ed-461b-9384-4c4146bcb778" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.727716] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c82c8392-77ed-461b-9384-4c4146bcb778',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.811523] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.814313] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.814313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.814608] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.815230] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.815230] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.815230] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.815230] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.815230] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.815230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.847033] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.847033] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.847033] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.847033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.847033] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-386d3142-ba3b-47b0-ab79-e69b6286321b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.847033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.847033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.847480] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.848060] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d3142-ba3b-47b0-ab79-e69b6286321b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.903256] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 in Status: SUCCESS [ 617.903256] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 deletion is rescheduled due to dependency. [ 617.903256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.229978] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c82c8392-77ed-461b-9384-4c4146bcb778 [ 618.230231] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.230559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.230665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.231084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.231084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.231238] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c82c8392-77ed-461b-9384-4c4146bcb778 already deleted. [ 618.231238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c82c8392-77ed-461b-9384-4c4146bcb778" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.350881] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.351183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.351323] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.351554] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.351708] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.351908] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 386d3142-ba3b-47b0-ab79-e69b6286321b not found, creating... [ 618.352739] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.352739] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.352739] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.352938] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.352938] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.353198] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.353363] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.353499] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.353722] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.353895] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.354039] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 386d3142-ba3b-47b0-ab79-e69b6286321b is going to be created. [ 618.386090] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.386221] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.386277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.386558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.386867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.387114] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389153] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 618.389153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.389153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.389511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.389511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.389511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.389716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.389716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.389909] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.731108] env[65080]: INFO networking_nsxv3.common.synchronization [None req-82bf2ff2-5d0c-408c-ace5-e4e82f6935ba None None] Enqueued Resource ID: 5018ca82-49c2-43f5-a58b-ff47aee2f009 with Priority: HIGHEST for action port [ 618.731897] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5018ca82-49c2-43f5-a58b-ff47aee2f009 with Priority: HIGHEST for action port [ 618.732927] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5018ca82-49c2-43f5-a58b-ff47aee2f009 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.733160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5018ca82-49c2-43f5-a58b-ff47aee2f009" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.733373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5018ca82-49c2-43f5-a58b-ff47aee2f009" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.733837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5018ca82-49c2-43f5-a58b-ff47aee2f009" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.734275] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5018ca82-49c2-43f5-a58b-ff47aee2f009',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.893260] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.237760] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5018ca82-49c2-43f5-a58b-ff47aee2f009 [ 619.237760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.237760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.237760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.238084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.238084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.238084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5018ca82-49c2-43f5-a58b-ff47aee2f009 already deleted. [ 619.238189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5018ca82-49c2-43f5-a58b-ff47aee2f009" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.341545] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a778f6-7aae-48bf-8dd0-db277e0185d6 req-fba5d0a8-ab51-4895-a57b-a78828560d22 service nova] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 619.341866] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a778f6-7aae-48bf-8dd0-db277e0185d6 req-fba5d0a8-ab51-4895-a57b-a78828560d22 service nova] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 619.341866] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a778f6-7aae-48bf-8dd0-db277e0185d6 req-fba5d0a8-ab51-4895-a57b-a78828560d22 service nova] Enqueued Resource ID: 386d3142-ba3b-47b0-ab79-e69b6286321b with Priority: HIGHEST for action port [ 619.342907] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 619.342907] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 619.342907] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386d3142-ba3b-47b0-ab79-e69b6286321b with Priority: HIGHEST for action port [ 619.343291] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.343479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.343554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.344878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.344878] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.346307] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.346430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.346499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.346681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.346860] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.346908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.346971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.347129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.347216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.347306] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.348546] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-386d3142-ba3b-47b0-ab79-e69b6286321b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.348689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.348886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.348886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.348967] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386d3142-ba3b-47b0-ab79-e69b6286321b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.399021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6910c0-f6a2-426f-8968-cad99131eb9b: rpc.has_security_group_logging(os_id): False [ 619.422759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.422759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.422759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.425254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.425453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.425774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.425811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.426723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.426723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.426723] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be created. [ 619.493405] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.493570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.493618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.493838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.494015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.507017] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 619.850606] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.851093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.851093] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.852240] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 386d3142-ba3b-47b0-ab79-e69b6286321b with status ACTIVE [ 619.852513] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.852705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.852905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.853014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.853114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.853318] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.853462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.853462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.854396] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.854396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.854396] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 386d3142-ba3b-47b0-ab79-e69b6286321b is going to be updated. [ 619.881776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.881776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.881776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.881776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.881776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.881776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-386d3142-ba3b-47b0-ab79-e69b6286321b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.220132] env[65080]: INFO networking_nsxv3.common.synchronization [req-ac9b46c4-35c3-4b2b-9970-b96c7bd296c7 req-745f163e-493c-4eec-af5e-4af66c08ef50 tempest-ListImageFiltersTestJSON-1314988663 tempest-ListImageFiltersTestJSON-1314988663-project-member] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 620.220864] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 620.221086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.221774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.221774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.221993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.222241] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.222356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.222461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.222770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.222770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.222865] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.357577] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.387750] env[65080]: INFO networking_nsxv3.common.synchronization [None req-11b79928-2822-482d-bc8f-64c9c44430f5 None None] Enqueued Resource ID: fe1f9e4b-57be-47c5-99b8-3d5b77599982 with Priority: HIGHEST for action port [ 620.387992] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1f9e4b-57be-47c5-99b8-3d5b77599982 with Priority: HIGHEST for action port [ 620.388546] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1f9e4b-57be-47c5-99b8-3d5b77599982 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.388677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1f9e4b-57be-47c5-99b8-3d5b77599982" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.388738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1f9e4b-57be-47c5-99b8-3d5b77599982" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.388989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1f9e4b-57be-47c5-99b8-3d5b77599982" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.392849] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1f9e4b-57be-47c5-99b8-3d5b77599982',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.582684] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.583412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.583412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.583412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.583558] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.583682] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.584472] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.584472] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.584472] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.584622] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.584663] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.584753] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.584853] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.584956] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.585064] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.585226] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.606862] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.607119] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.607257] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.607429] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.608466] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c61ff396-5d56-4375-8eb3-1df8dc81203c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.609255] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.609255] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.609418] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.609559] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c61ff396-5d56-4375-8eb3-1df8dc81203c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.657944] env[65080]: INFO networking_nsxv3.common.synchronization [None req-56ce545b-2169-4260-8e82-a810de57b43d None None] Enqueued Resource ID: 32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e with Priority: HIGHEST for action port [ 620.658887] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e with Priority: HIGHEST for action port [ 620.659224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.659373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.659435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.659786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.659786] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.725443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.725588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.725652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.725917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.726049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.726262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.726380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.726597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.726676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.726783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.726894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e already deleted. [ 620.727024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.859585] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.859934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.859934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.860065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.861131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.861131] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be created. [ 620.890842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.890842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.890842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.890842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.890842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.894490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe1f9e4b-57be-47c5-99b8-3d5b77599982 [ 620.894590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.894717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.895168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.895168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.895168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.895314] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe1f9e4b-57be-47c5-99b8-3d5b77599982 already deleted. [ 620.895396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1f9e4b-57be-47c5-99b8-3d5b77599982" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.901963] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: UNINITIALIZED for 2s [ 621.112175] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.112490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.112650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.112859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.113019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.113177] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c61ff396-5d56-4375-8eb3-1df8dc81203c not found, creating... [ 621.113405] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.113581] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.113694] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.113932] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.114088] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.114487] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.114584] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.114680] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.115137] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.115137] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.115235] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c61ff396-5d56-4375-8eb3-1df8dc81203c is going to be created. [ 621.135286] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.135418] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.135626] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.135877] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.136119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.136462] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.162107] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e [ 621.162347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.162521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.162594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.162963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.162963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.163108] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e already deleted. [ 621.163108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32cdd0b0-bf4e-4ce4-a4ca-909b2a2dbd9e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.519507] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 621.519754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.042122] env[65080]: INFO networking_nsxv3.common.synchronization [req-ac9b46c4-35c3-4b2b-9970-b96c7bd296c7 req-6eb53d70-88f8-48e1-ba34-352f0d7d429d service nova] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_rules [ 622.042372] env[65080]: INFO networking_nsxv3.common.synchronization [req-ac9b46c4-35c3-4b2b-9970-b96c7bd296c7 req-6eb53d70-88f8-48e1-ba34-352f0d7d429d service nova] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 622.042568] env[65080]: INFO networking_nsxv3.common.synchronization [req-ac9b46c4-35c3-4b2b-9970-b96c7bd296c7 req-6eb53d70-88f8-48e1-ba34-352f0d7d429d service nova] Enqueued Resource ID: c61ff396-5d56-4375-8eb3-1df8dc81203c with Priority: HIGHEST for action port [ 622.044045] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_rules [ 622.044272] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 622.044344] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c61ff396-5d56-4375-8eb3-1df8dc81203c with Priority: HIGHEST for action port [ 622.048021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.048021] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.048021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.048021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.048021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.048021] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.048774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c61ff396-5d56-4375-8eb3-1df8dc81203c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.048774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.049158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.049158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.049220] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c61ff396-5d56-4375-8eb3-1df8dc81203c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.053309] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7a9f8372-f151-42de-96f8-8d5dfbcd8c91 tempest-ServersTestFqdnHostnames-872778182 tempest-ServersTestFqdnHostnames-872778182-project-member] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 622.053782] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 622.054083] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.054186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.054253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.054484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.054557] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.213243] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c9a91898-bfa3-413e-bc45-4bf4271651cc tempest-ServersTestFqdnHostnames-872778182 tempest-ServersTestFqdnHostnames-872778182-project-member] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 622.213887] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 622.215279] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.215465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.552331] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.552331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.552331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c61ff396-5d56-4375-8eb3-1df8dc81203c with status ACTIVE [ 622.553134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.553243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.553311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554889] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c61ff396-5d56-4375-8eb3-1df8dc81203c is going to be updated. [ 622.556123] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.578954] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.579164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.579235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.579598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.579671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.579927] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce already deleted. [ 622.579979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.580179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.580402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.581089] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.585903] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.586021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.586093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.586278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.586417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.586565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c61ff396-5d56-4375-8eb3-1df8dc81203c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.912396] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 622.912704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.912930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.913157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.913388] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.913542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.913623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.913787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.913888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.913982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.914118] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.058850] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.113104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.113297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.113403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.113604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.113788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.114192] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce already deleted. [ 623.114192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.416495] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.562095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.562240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.562369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.562574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.562650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.562766] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be created. [ 623.595292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.595292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.595292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.595292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.595292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.603997] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: UNINITIALIZED for 2s [ 623.683899] env[65080]: INFO networking_nsxv3.common.synchronization [None req-494d70da-9f56-4f2b-bf7a-a5989ebdb6ad None None] Enqueued Resource ID: 16aa1403-4490-44e8-8457-2efc116b706d with Priority: HIGHEST for action port [ 623.685847] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16aa1403-4490-44e8-8457-2efc116b706d with Priority: HIGHEST for action port [ 623.685946] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-16aa1403-4490-44e8-8457-2efc116b706d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.686119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16aa1403-4490-44e8-8457-2efc116b706d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.686176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16aa1403-4490-44e8-8457-2efc116b706d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.686444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16aa1403-4490-44e8-8457-2efc116b706d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.686530] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16aa1403-4490-44e8-8457-2efc116b706d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.923061] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0: rpc.has_security_group_logging(os_id): False [ 623.944329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.944688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.944688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.945177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.945177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.945319] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.945319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.945418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.945560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.945676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.945756] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be created. [ 624.019393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.019969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.019969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.020238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.020472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.035171] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 624.189576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16aa1403-4490-44e8-8457-2efc116b706d [ 624.189576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.189576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.189939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.189939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.189939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.190034] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16aa1403-4490-44e8-8457-2efc116b706d already deleted. [ 624.190698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16aa1403-4490-44e8-8457-2efc116b706d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.433808] env[65080]: INFO networking_nsxv3.common.synchronization [req-a61d600b-cb93-4bce-aab0-2780e4dc5ed6 req-e46b2738-51c2-41be-8819-8259f28c1fdb tempest-ListImageFiltersTestJSON-1314988663 tempest-ListImageFiltersTestJSON-1314988663-project-member] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 624.434431] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 624.434890] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.435407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.908917] env[65080]: INFO networking_nsxv3.common.synchronization [None req-ef4bc843-1157-41fe-aab8-debc7cc0e771 None None] Enqueued Resource ID: 2d12a440-83ab-44c9-9a64-70de052f2197 with Priority: HIGHEST for action port [ 624.909185] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d12a440-83ab-44c9-9a64-70de052f2197 with Priority: HIGHEST for action port [ 624.909750] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d12a440-83ab-44c9-9a64-70de052f2197 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.909861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d12a440-83ab-44c9-9a64-70de052f2197" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.910253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d12a440-83ab-44c9-9a64-70de052f2197" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.910253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d12a440-83ab-44c9-9a64-70de052f2197" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.910253] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d12a440-83ab-44c9-9a64-70de052f2197',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.414913] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d12a440-83ab-44c9-9a64-70de052f2197 [ 625.415325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.415396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.415432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.415636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.415745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.416340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d12a440-83ab-44c9-9a64-70de052f2197 already deleted. [ 625.416340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d12a440-83ab-44c9-9a64-70de052f2197" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.429819] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.430501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.430841] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.434022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.434022] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.434022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.434022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.434022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.434022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.434022] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.434022] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.434022] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.434022] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.434022] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.434022] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.434022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.459119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.459119] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.459119] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.459119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.459119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-b9c3c762-3348-4c6b-9e3f-8801862f295d taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.459119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.459119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.459119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.460128] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c3c762-3348-4c6b-9e3f-8801862f295d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.615104] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 625.615369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.616470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.616470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.616470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.616470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.616470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.616470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.616748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.616748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.616831] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.618061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.618936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.618936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.618936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.618936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.618936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.618936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.619228] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.962894] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.963080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.963314] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.963551] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.963705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.964811] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port b9c3c762-3348-4c6b-9e3f-8801862f295d not found, creating... [ 625.964811] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.964811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.964811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.964811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.964811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.965087] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.965205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.965313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.965516] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.965645] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.965874] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: b9c3c762-3348-4c6b-9e3f-8801862f295d is going to be created. [ 625.987418] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.987622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.987741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.988021] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.988232] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.988446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.048770] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 626.048770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.121736] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.121951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.123342] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.627450] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.676807] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e9d4e8-2cbb-476f-8a7f-964db7cbeed0 req-530b4dc2-e5d7-4fdd-80ba-158649fb2a86 tempest-TenantUsagesTestJSON-489485943 tempest-TenantUsagesTestJSON-489485943-project-member] Enqueued Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 626.677477] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGHEST for action security_group_members [ 626.677656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.677914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.677914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.678106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.678251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.678383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.678462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.678652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.678959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.678959] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.706880] env[65080]: INFO networking_nsxv3.common.synchronization [req-a61d600b-cb93-4bce-aab0-2780e4dc5ed6 req-baed8b4b-dcbd-45c0-9ec3-397174d30bad service nova] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_rules [ 626.706880] env[65080]: INFO networking_nsxv3.common.synchronization [req-a61d600b-cb93-4bce-aab0-2780e4dc5ed6 req-baed8b4b-dcbd-45c0-9ec3-397174d30bad service nova] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 626.708539] env[65080]: INFO networking_nsxv3.common.synchronization [req-a61d600b-cb93-4bce-aab0-2780e4dc5ed6 req-baed8b4b-dcbd-45c0-9ec3-397174d30bad service nova] Enqueued Resource ID: b9c3c762-3348-4c6b-9e3f-8801862f295d with Priority: HIGHEST for action port [ 626.709474] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_rules [ 626.710689] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 626.710689] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c3c762-3348-4c6b-9e3f-8801862f295d with Priority: HIGHEST for action port [ 626.711972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.711972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.711972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.711972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.711972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9c3c762-3348-4c6b-9e3f-8801862f295d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.713173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.713173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.713173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.713173] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c3c762-3348-4c6b-9e3f-8801862f295d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.718749] env[65080]: INFO networking_nsxv3.common.synchronization [None req-95f865e7-9a73-49d9-8fe0-16f6da580262 None None] Enqueued Resource ID: 061425a1-7528-497d-b2d6-4fe4a151a71a with Priority: HIGHEST for action port [ 626.719536] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061425a1-7528-497d-b2d6-4fe4a151a71a with Priority: HIGHEST for action port [ 626.719836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-061425a1-7528-497d-b2d6-4fe4a151a71a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.719960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-061425a1-7528-497d-b2d6-4fe4a151a71a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.720041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-061425a1-7528-497d-b2d6-4fe4a151a71a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.720296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-061425a1-7528-497d-b2d6-4fe4a151a71a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.720373] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('061425a1-7528-497d-b2d6-4fe4a151a71a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.131317] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.131317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.131317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.131317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.131317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.131317] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be updated. [ 627.171329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.171478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.171548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.172031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.172118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.181709] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.181862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.181937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.182188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.182423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.185718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.185718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.185718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.185718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.185718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.185718] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec is going to be updated. [ 627.186447] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 627.219198] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9c3c762-3348-4c6b-9e3f-8801862f295d with status ACTIVE [ 627.219198] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.219313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.219347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.220224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.220224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.220224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.220224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.220224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.220224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.220497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.220497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.220583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.220655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.220805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.220880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.221048] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9c3c762-3348-4c6b-9e3f-8801862f295d is going to be updated. [ 627.224890] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.225053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.225105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.225531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.225531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.226900] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 061425a1-7528-497d-b2d6-4fe4a151a71a [ 627.227382] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.227583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.227583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.227770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.227841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.227930] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:061425a1-7528-497d-b2d6-4fe4a151a71a already deleted. [ 627.228074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-061425a1-7528-497d-b2d6-4fe4a151a71a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.245110] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: IN_PROGRESS for 2s [ 627.257241] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.257241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.257241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.258404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.258404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.258404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9c3c762-3348-4c6b-9e3f-8801862f295d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.828185] env[65080]: INFO networking_nsxv3.common.synchronization [req-ba5319ac-2d5d-444d-8a1a-7b8878310a19 req-ce94fbed-a3fb-4e26-8121-9c72cd1eb040 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 628.829785] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 628.830268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.830409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.830479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.830750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.830919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.831090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.831252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.831427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.831624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.831624] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.200521] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 629.201096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.201096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.201290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.201533] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.201689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.201777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.201960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.202090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.202205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.202392] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.202499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.202628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.202808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.202976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.203136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.203207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.203355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.203433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.203519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.203609] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.204486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.204655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.204816] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.204917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.204977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.205136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.205211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.205299] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.256804] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec in Status: SUCCESS [ 629.257040] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec deletion is rescheduled due to dependency. [ 629.257159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.334207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.334390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.334472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.334726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.334834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.335228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.335228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.335228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.335489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.335489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.335489] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 already deleted. [ 629.335859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.357604] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9cc9852a-25b3-4b1f-82f6-cf07db0931d1 None None] Enqueued Resource ID: 4c518d59-5df6-4653-a3db-ea897432d889 with Priority: HIGHEST for action port [ 629.357604] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c518d59-5df6-4653-a3db-ea897432d889 with Priority: HIGHEST for action port [ 629.357920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c518d59-5df6-4653-a3db-ea897432d889 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.358128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c518d59-5df6-4653-a3db-ea897432d889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.358210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c518d59-5df6-4653-a3db-ea897432d889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.358461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c518d59-5df6-4653-a3db-ea897432d889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.358537] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c518d59-5df6-4653-a3db-ea897432d889',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.664594] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.664766] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.664914] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.665537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.665537] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.665964] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.666245] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.666479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.666619] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.666859] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.667341] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.667341] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.667341] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.667473] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.667505] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.667626] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.687423] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.687594] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.687783] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.687967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.689473] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-bcd592a8-a86a-4960-a5de-a23fda8871c5 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.689677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.690107] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.690218] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.690280] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd592a8-a86a-4960-a5de-a23fda8871c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.706535] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e: rpc.has_security_group_logging(os_id): False [ 629.707830] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.752069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.752069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.752069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.752069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.752069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.752069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.752581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.752581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.752581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.752581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.752732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.752780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.752893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.752988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.753113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.753290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.753378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.753447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.753729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.753729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.753729] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be created. [ 629.813705] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.813916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.813962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.814160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.814342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.828371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 629.859991] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c518d59-5df6-4653-a3db-ea897432d889 [ 629.860256] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.860545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.860616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.860856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.860917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.861024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c518d59-5df6-4653-a3db-ea897432d889 already deleted. [ 629.861153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c518d59-5df6-4653-a3db-ea897432d889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.192626] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.192885] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.193017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.193313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.193483] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.193636] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port bcd592a8-a86a-4960-a5de-a23fda8871c5 not found, creating... [ 630.193914] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.194090] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.194205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.194425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.194559] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.195042] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.195042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.195220] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.195293] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.195438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.195563] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: bcd592a8-a86a-4960-a5de-a23fda8871c5 is going to be created. [ 630.211633] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.217698] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.218090] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.218226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.218588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.218903] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.219397] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.717041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.717041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.717041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.717041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.717041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.717041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be updated. [ 630.749840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.750189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.750189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.750304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.750475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.766557] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 631.000089] env[65080]: INFO networking_nsxv3.common.synchronization [None req-11b8cd02-cc28-4c59-8e4e-9bab04fb95ff None None] Enqueued Resource ID: 3eae13bd-6144-4a02-8cd1-05074dd3f253 with Priority: HIGHEST for action port [ 631.001041] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eae13bd-6144-4a02-8cd1-05074dd3f253 with Priority: HIGHEST for action port [ 631.002631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eae13bd-6144-4a02-8cd1-05074dd3f253 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.002631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eae13bd-6144-4a02-8cd1-05074dd3f253" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.002783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eae13bd-6144-4a02-8cd1-05074dd3f253" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.003576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eae13bd-6144-4a02-8cd1-05074dd3f253" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.003576] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eae13bd-6144-4a02-8cd1-05074dd3f253',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.007591] env[65080]: INFO networking_nsxv3.common.synchronization [req-ba5319ac-2d5d-444d-8a1a-7b8878310a19 req-438baffa-573a-4a21-8579-9da23ab69a27 service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 631.007591] env[65080]: INFO networking_nsxv3.common.synchronization [req-ba5319ac-2d5d-444d-8a1a-7b8878310a19 req-438baffa-573a-4a21-8579-9da23ab69a27 service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 631.007791] env[65080]: INFO networking_nsxv3.common.synchronization [req-ba5319ac-2d5d-444d-8a1a-7b8878310a19 req-438baffa-573a-4a21-8579-9da23ab69a27 service nova] Enqueued Resource ID: bcd592a8-a86a-4960-a5de-a23fda8871c5 with Priority: HIGHEST for action port [ 631.008496] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 631.008705] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 631.008922] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd592a8-a86a-4960-a5de-a23fda8871c5 with Priority: HIGHEST for action port [ 631.009943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.009943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.009943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.010226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.010226] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.010939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.011084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.011424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.011617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.011774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.011905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.011969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.012129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.012215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.012307] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.014857] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd592a8-a86a-4960-a5de-a23fda8871c5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.014857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.014857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.014857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.014857] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd592a8-a86a-4960-a5de-a23fda8871c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.508732] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3eae13bd-6144-4a02-8cd1-05074dd3f253 [ 631.510055] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.510055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.510055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.510055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.510055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.510055] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3eae13bd-6144-4a02-8cd1-05074dd3f253 already deleted. [ 631.510055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eae13bd-6144-4a02-8cd1-05074dd3f253" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.522355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.522355] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.522355] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcd592a8-a86a-4960-a5de-a23fda8871c5 with status ACTIVE [ 631.522355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.522355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.522355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.522917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.522917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.522917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.522917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.522917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.522917] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcd592a8-a86a-4960-a5de-a23fda8871c5 is going to be updated. [ 631.547821] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.547821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.547821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.547821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.547821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.547821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd592a8-a86a-4960-a5de-a23fda8871c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.843242] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 631.843487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.843644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.844360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.844360] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.026883] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.348764] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.348764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.529585] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.529803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.529913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.530280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.530430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.530586] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be created. [ 632.567067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.567227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.567309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.567544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.567811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.582493] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: UNINITIALIZED for 2s [ 632.776842] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 632.778051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.778051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.778051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.778051] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.778413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.778413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.778413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.778561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.778561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.778670] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.894269] env[65080]: INFO networking_nsxv3.common.synchronization [req-c3e104c7-69b8-4a17-ab76-c931bee4b3f5 req-661b92c9-f109-4e9d-924b-5f45b5d34280 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 632.894859] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 632.895369] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.895494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.140813] env[65080]: INFO networking_nsxv3.common.synchronization [None req-091e7972-1bde-4a85-a403-bc441196cc05 None None] Enqueued Resource ID: 8b169143-9150-4283-afd3-d950c3e07daa with Priority: HIGHEST for action port [ 633.140813] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b169143-9150-4283-afd3-d950c3e07daa with Priority: HIGHEST for action port [ 633.142569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b169143-9150-4283-afd3-d950c3e07daa taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.142569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b169143-9150-4283-afd3-d950c3e07daa" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.142569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b169143-9150-4283-afd3-d950c3e07daa" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.142569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b169143-9150-4283-afd3-d950c3e07daa" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.142776] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b169143-9150-4283-afd3-d950c3e07daa',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.282354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.282549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.282632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.283755] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.283755] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.283755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.284200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.284200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.284200] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.284200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.284200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.284354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.284385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.284461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.284557] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.637854] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.638076] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.638197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.638459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.638707] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.638872] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.638996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.639539] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.639722] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.639969] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.640120] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.640252] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.640379] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.640538] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.640695] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.640881] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.645407] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b169143-9150-4283-afd3-d950c3e07daa [ 633.645647] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.645796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.645889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.646111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.646214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.646328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b169143-9150-4283-afd3-d950c3e07daa already deleted. [ 633.646432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b169143-9150-4283-afd3-d950c3e07daa" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.659926] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.660200] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.660398] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.660679] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.661207] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.661442] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.661593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.661948] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.662134] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d2cdaf4-ec2b-473b-8016-b6693a2c7b15',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.789055] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e: rpc.has_security_group_logging(os_id): False [ 633.808625] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.808810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.808891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.809124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.809218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.809660] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.809660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.809660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.809891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.809891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.809977] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.810044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.810138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.810249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.810322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.810525] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.810665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.810725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.810867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.810943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.811294] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be updated. [ 633.877046] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.877046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.877046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.877046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.877046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.893949] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 634.165046] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.165477] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.165477] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.165621] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.165775] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.165918] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 not found, creating... [ 634.166197] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.166340] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.166450] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.166689] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.166823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.167111] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.167248] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.167385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.167554] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.167683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.167820] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 is going to be created. [ 634.190355] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.190723] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.190920] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.191897] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.191897] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.191897] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.594222] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 634.594441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.594606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.594822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.595065] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.595206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.595280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.595443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.595526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.595616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.595716] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.596578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.596749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.596911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.597025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.597087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.597230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.597307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.597393] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.913534] env[65080]: INFO networking_nsxv3.common.synchronization [req-c3e104c7-69b8-4a17-ab76-c931bee4b3f5 req-a901860f-2958-4172-94e9-74e2db35f198 service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 634.913772] env[65080]: INFO networking_nsxv3.common.synchronization [req-c3e104c7-69b8-4a17-ab76-c931bee4b3f5 req-a901860f-2958-4172-94e9-74e2db35f198 service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 634.913894] env[65080]: INFO networking_nsxv3.common.synchronization [req-c3e104c7-69b8-4a17-ab76-c931bee4b3f5 req-a901860f-2958-4172-94e9-74e2db35f198 service nova] Enqueued Resource ID: 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 with Priority: HIGHEST for action port [ 634.914521] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 634.914724] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 634.914844] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 with Priority: HIGHEST for action port [ 634.918176] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.918176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.918349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.918552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.918614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.918706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.918773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.918976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.919060] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d2cdaf4-ec2b-473b-8016-b6693a2c7b15',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.098936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.099076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.099185] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.338274] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3b54dcb0-a5d6-4495-b8c8-1647af370535 None None] Enqueued Resource ID: 3e18527b-1928-41f9-875f-fe3d58f1d73e with Priority: HIGHEST for action port [ 635.339143] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e18527b-1928-41f9-875f-fe3d58f1d73e with Priority: HIGHEST for action port [ 635.340997] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e18527b-1928-41f9-875f-fe3d58f1d73e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.341681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e18527b-1928-41f9-875f-fe3d58f1d73e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.341681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e18527b-1928-41f9-875f-fe3d58f1d73e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.342657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e18527b-1928-41f9-875f-fe3d58f1d73e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.342950] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e18527b-1928-41f9-875f-fe3d58f1d73e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.421533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 with status ACTIVE [ 635.422245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.422245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.422245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.422245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.422764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.422764] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.422764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.422764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.422905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.422946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423118] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.423215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.423277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.423450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.423482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423561] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d2cdaf4-ec2b-473b-8016-b6693a2c7b15 is going to be updated. [ 635.445956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.446248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.446335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.447214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.447214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.447214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d2cdaf4-ec2b-473b-8016-b6693a2c7b15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.605917] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.762386] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5afcf8c4-40de-4dc2-aa25-76fe79e063c0 None None] Enqueued Resource ID: ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb with Priority: HIGHEST for action port [ 635.762386] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb with Priority: HIGHEST for action port [ 635.762386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.762386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.762386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.762386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.762386] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.845946] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e18527b-1928-41f9-875f-fe3d58f1d73e [ 635.846215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.846362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.846429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.846688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.846780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.846899] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e18527b-1928-41f9-875f-fe3d58f1d73e already deleted. [ 635.846985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e18527b-1928-41f9-875f-fe3d58f1d73e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.912543] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 635.912982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.108577] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.108744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.108810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.109054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.109185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.109287] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 636.145632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.145787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.145845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.146074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.146215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.157394] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 636.269184] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb [ 636.269423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.269552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.269622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.269836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.269926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.270038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb already deleted. [ 636.270115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1f811a-32f9-4c6c-88c7-3a9a4ad2c6fb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.740688] env[65080]: INFO networking_nsxv3.common.synchronization [None req-def7c932-a2fa-4d24-8b76-a42b267f482f None None] Enqueued Resource ID: 48d548ca-12dd-4ea1-a460-32d3cca8625a with Priority: HIGHEST for action port [ 636.741496] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d548ca-12dd-4ea1-a460-32d3cca8625a with Priority: HIGHEST for action port [ 636.741713] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-48d548ca-12dd-4ea1-a460-32d3cca8625a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.741878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48d548ca-12dd-4ea1-a460-32d3cca8625a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.741878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48d548ca-12dd-4ea1-a460-32d3cca8625a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.742531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48d548ca-12dd-4ea1-a460-32d3cca8625a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.742531] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d548ca-12dd-4ea1-a460-32d3cca8625a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.772022] env[65080]: INFO networking_nsxv3.common.synchronization [req-a5607a7c-18a7-47c6-a4ce-65bfc6901f7c req-5b622860-ad40-4478-a202-47fd7438752b tempest-ServerActionsV293TestJSON-2025792179 tempest-ServerActionsV293TestJSON-2025792179-project-member] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 636.772022] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 636.772022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.772022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.772022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.772645] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.246301] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48d548ca-12dd-4ea1-a460-32d3cca8625a [ 637.246770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.246980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.247126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.247551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.247721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.247884] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48d548ca-12dd-4ea1-a460-32d3cca8625a already deleted. [ 637.248066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48d548ca-12dd-4ea1-a460-32d3cca8625a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.276368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.276575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.276983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.277305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.278333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.278711] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.278846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.278977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.279234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.279417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.279491] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a already deleted. [ 637.280968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.552179] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.552374] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-815" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.552484] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-815" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.552842] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-815" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.553394] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.553394] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.553394] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.553759] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.553759] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.554602] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.555710] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.556072] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.556258] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.556854] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.556854] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.556854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.580612] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.580848] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.580987] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.581179] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-815" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.581507] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-5ce1593d-5e9b-442c-baad-0c6888475f17 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.581708] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.581853] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.582238] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.582369] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce1593d-5e9b-442c-baad-0c6888475f17',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.090025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.090025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 5ce1593d-5e9b-442c-baad-0c6888475f17 not found, creating... [ 638.090025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.090025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.091272] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.091475] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.091554] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.091793] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.091924] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.092069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 5ce1593d-5e9b-442c-baad-0c6888475f17 is going to be created. [ 638.115044] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.115271] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.115397] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.115667] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.115893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.116127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.169936] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 638.170747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.170747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.170747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.170886] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.171033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.171094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.173584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.173717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.173864] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.678865] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.716574] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c7296648-d1b9-489e-9ef5-707cffe513fd None None] Enqueued Resource ID: 1584b608-ca15-43d3-b384-1dcd48c9f290 with Priority: HIGHEST for action port [ 638.717316] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1584b608-ca15-43d3-b384-1dcd48c9f290 with Priority: HIGHEST for action port [ 638.717668] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1584b608-ca15-43d3-b384-1dcd48c9f290 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.717826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1584b608-ca15-43d3-b384-1dcd48c9f290" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.717899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1584b608-ca15-43d3-b384-1dcd48c9f290" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.720385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1584b608-ca15-43d3-b384-1dcd48c9f290" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.720480] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1584b608-ca15-43d3-b384-1dcd48c9f290',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.817114] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6c6b81ab-ba92-4e0b-ac0b-13eaa98dc5ce None None] Enqueued Resource ID: 3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0 with Priority: HIGHEST for action port [ 638.819140] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0 with Priority: HIGHEST for action port [ 638.819140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.819140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.819140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.819140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.819140] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.874022] env[65080]: INFO networking_nsxv3.common.synchronization [req-a5607a7c-18a7-47c6-a4ce-65bfc6901f7c req-a58e54fd-98e8-4672-a27d-25f6cbc5251d service nova] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 638.874022] env[65080]: INFO networking_nsxv3.common.synchronization [req-a5607a7c-18a7-47c6-a4ce-65bfc6901f7c req-a58e54fd-98e8-4672-a27d-25f6cbc5251d service nova] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 638.874022] env[65080]: INFO networking_nsxv3.common.synchronization [req-a5607a7c-18a7-47c6-a4ce-65bfc6901f7c req-a58e54fd-98e8-4672-a27d-25f6cbc5251d service nova] Enqueued Resource ID: 5ce1593d-5e9b-442c-baad-0c6888475f17 with Priority: HIGHEST for action port [ 638.874022] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_rules [ 638.877055] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 638.877055] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce1593d-5e9b-442c-baad-0c6888475f17 with Priority: HIGHEST for action port [ 638.877055] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.877055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.877055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.877055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.877055] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.877635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.877635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.877635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.877635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.877635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.878326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.878326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.878326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.878326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.878326] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.881232] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ce1593d-5e9b-442c-baad-0c6888475f17 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.881232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.881232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.881232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.881232] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce1593d-5e9b-442c-baad-0c6888475f17',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.181376] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.225751] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1584b608-ca15-43d3-b384-1dcd48c9f290 [ 639.225872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.225950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.225991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.226248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.226393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.226393] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1584b608-ca15-43d3-b384-1dcd48c9f290 already deleted. [ 639.226460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1584b608-ca15-43d3-b384-1dcd48c9f290" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.321863] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0 [ 639.322174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.322174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.322275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.322937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.322937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.322937] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0 already deleted. [ 639.322937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d77bc51-942e-46ca-a2bc-ffd3d8f1d0d0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.384451] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.384451] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ce1593d-5e9b-442c-baad-0c6888475f17 with status ACTIVE [ 639.384451] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.384451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.384451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.385434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.385434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.385688] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.385688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.385762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.385873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.385937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.386012] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ce1593d-5e9b-442c-baad-0c6888475f17 is going to be updated. [ 639.389458] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.389458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.413224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.413629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.413629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.413629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.414024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.414024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ce1593d-5e9b-442c-baad-0c6888475f17" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.684309] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.685190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.685190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.685190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.685347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.685416] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 639.745242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.745242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.745242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.745768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.746773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.768656] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 639.788186] env[65080]: INFO networking_nsxv3.common.synchronization [req-3302cf3a-9c34-4146-90d2-e6003c327fa7 req-ce13d3b9-c139-41f6-a167-4e1b21435683 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 639.788570] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 639.788915] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.789060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.789125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.789409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.789576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.789683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.789771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.789959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.790059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.790163] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.891330] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.102666] env[65080]: INFO networking_nsxv3.common.synchronization [None req-675135c7-f735-486c-b2d0-6674010427ed None None] Enqueued Resource ID: 792a94d2-d00c-41c6-80c4-94eea5ee5cd4 with Priority: HIGHEST for action port [ 640.103460] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792a94d2-d00c-41c6-80c4-94eea5ee5cd4 with Priority: HIGHEST for action port [ 640.103867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-792a94d2-d00c-41c6-80c4-94eea5ee5cd4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.103995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-792a94d2-d00c-41c6-80c4-94eea5ee5cd4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.104126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-792a94d2-d00c-41c6-80c4-94eea5ee5cd4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.106870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-792a94d2-d00c-41c6-80c4-94eea5ee5cd4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.106986] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('792a94d2-d00c-41c6-80c4-94eea5ee5cd4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.292140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.292460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.292460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.292747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.292853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.293392] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.293392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.293392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.294021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.294021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.294021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 already deleted. [ 640.294021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.395471] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.395471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.395471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.395471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.395471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.395471] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a is going to be created. [ 640.421015] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.421242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.421302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.421532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.421734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.431194] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.431417] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.431546] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.431911] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.432189] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.432343] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.432457] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.432884] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.432959] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.433177] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.433293] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.433399] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.433517] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.433649] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.433817] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.433980] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.437074] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: UNINITIALIZED for 2s [ 640.459631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.459755] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.459813] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.459966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.460303] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-fdf200bd-8d9f-4ce4-976a-7528409b55d9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.460476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.460617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.460942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.461094] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf200bd-8d9f-4ce4-976a-7528409b55d9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.613453] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 792a94d2-d00c-41c6-80c4-94eea5ee5cd4 [ 640.614475] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.614475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.614475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.614475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.614475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.614475] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:792a94d2-d00c-41c6-80c4-94eea5ee5cd4 already deleted. [ 640.614475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-792a94d2-d00c-41c6-80c4-94eea5ee5cd4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.966052] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.966052] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port fdf200bd-8d9f-4ce4-976a-7528409b55d9 not found, creating... [ 640.966052] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.966052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.966700] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.968207] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.968645] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.968862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.968994] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.969309] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.969502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.969644] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: fdf200bd-8d9f-4ce4-976a-7528409b55d9 is going to be created. [ 640.992064] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.992189] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.992263] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.992531] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.992789] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.993054] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.062025] env[65080]: INFO networking_nsxv3.common.synchronization [None req-36cd92f3-5323-46df-a273-89751320dd69 None None] Enqueued Resource ID: 7c5c1823-093a-4fff-a3bd-acbfcb5b6128 with Priority: HIGHEST for action port [ 641.062687] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5c1823-093a-4fff-a3bd-acbfcb5b6128 with Priority: HIGHEST for action port [ 641.062977] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c5c1823-093a-4fff-a3bd-acbfcb5b6128 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.063840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c5c1823-093a-4fff-a3bd-acbfcb5b6128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.063929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c5c1823-093a-4fff-a3bd-acbfcb5b6128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.064192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c5c1823-093a-4fff-a3bd-acbfcb5b6128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.064275] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5c1823-093a-4fff-a3bd-acbfcb5b6128',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.406761] env[65080]: INFO networking_nsxv3.common.synchronization [None req-574c7cf5-97cf-4dd4-8be3-9fbe369d67e6 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 641.410289] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 641.410289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.410289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.410289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.411842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.412126] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.566655] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c5c1823-093a-4fff-a3bd-acbfcb5b6128 [ 641.566906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.567159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.567292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.567549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.567691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.567832] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c5c1823-093a-4fff-a3bd-acbfcb5b6128 already deleted. [ 641.567946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c5c1823-093a-4fff-a3bd-acbfcb5b6128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.780177] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.785301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.785301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.787855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.787855] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [req-3302cf3a-9c34-4146-90d2-e6003c327fa7 req-dceaa2bb-d5ac-4d55-b2db-99014ca03e21 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [req-3302cf3a-9c34-4146-90d2-e6003c327fa7 req-dceaa2bb-d5ac-4d55-b2db-99014ca03e21 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [req-3302cf3a-9c34-4146-90d2-e6003c327fa7 req-dceaa2bb-d5ac-4d55-b2db-99014ca03e21 service nova] Enqueued Resource ID: fdf200bd-8d9f-4ce4-976a-7528409b55d9 with Priority: HIGHEST for action port [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 641.804075] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf200bd-8d9f-4ce4-976a-7528409b55d9 with Priority: HIGHEST for action port [ 641.804766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.805042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.805202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.805540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.805741] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.806815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.807077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.807234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.807620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.807918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.808166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.808333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.808615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.809294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.809496] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.811131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf200bd-8d9f-4ce4-976a-7528409b55d9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.811444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.811606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.812728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.812728] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf200bd-8d9f-4ce4-976a-7528409b55d9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.909970] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c75517a3-f10f-47e3-bb19-c509fe734938 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 641.910536] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 641.911047] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.911196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.948201] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.949552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.949693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.949927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.950045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.950148] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf already deleted. [ 641.950231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.950409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.950598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.950699] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.292127] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 368f5d0c-dc76-4d4f-b69c-1d60821659c2: rpc.has_security_group_logging(os_id): False [ 642.315190] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.315477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.315996] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.317077] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdf200bd-8d9f-4ce4-976a-7528409b55d9 with status ACTIVE [ 642.318777] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.318777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.318777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.318777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.319350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.319350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.320249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.320249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.320249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.320249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.320550] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.320550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.320658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.320800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.321841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.321841] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdf200bd-8d9f-4ce4-976a-7528409b55d9 is going to be updated. [ 642.323218] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.323446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.323490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.323734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.323851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.324090] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.324197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.324258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.324443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.325162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.325162] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.325162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.325350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.325987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.325987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.325987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.325987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.326549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.326773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.326938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.327106] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be created. [ 642.362299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.362299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.362299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.362733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.362995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.366345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf200bd-8d9f-4ce4-976a-7528409b55d9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.432630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.433113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.433113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.433202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.433475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.450304] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: SUCCESS [ 642.450304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.450304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.450304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.450304] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.450304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.450778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.450778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.450778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.450778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.450778] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.465114] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 642.483791] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.484015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.484015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.484320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.484413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.484549] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf already deleted. [ 642.484589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.594623] env[65080]: INFO networking_nsxv3.common.synchronization [req-24847ca8-d902-42bc-acf6-e23795bdcfef req-f9103438-49f7-4225-9c61-5f25e2f1c500 tempest-ServerMetadataNegativeTestJSON-1973104987 tempest-ServerMetadataNegativeTestJSON-1973104987-project-member] Enqueued Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 642.594623] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 642.594623] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.595052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.595052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.595128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.595710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.595710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.595710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.595710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.595710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.596067] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.831298] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.954247] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.044273] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.044986] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.045259] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.045716] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.046194] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.046478] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.046706] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.047102] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.047359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.047692] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.047907] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.048156] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.048372] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.049129] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.049129] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.049129] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.073359] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.073359] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.073359] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.073359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-701" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.073359] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-33c55905-ffa9-49cf-a036-172dff9f2fa4 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.073359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.073359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.073359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.073359] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c55905-ffa9-49cf-a036-172dff9f2fa4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.098544] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.098544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.098692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.098822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.098909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.099703] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.100225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.100382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.100650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.101376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.101376] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 already deleted. [ 643.101376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.333796] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.334376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.338309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.338734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.338734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.338943] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be created. [ 643.376914] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.377187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.377187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.377424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.377571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.388275] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: UNINITIALIZED for 2s [ 643.456281] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db21a227-1ffb-4e1a-8c5e-6d7e45c3755a: rpc.has_security_group_logging(os_id): False [ 643.481802] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.481968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.482051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.482333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.482425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.482710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.482811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.482870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.483072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.483132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.483212] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a is going to be created. [ 643.553242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.553242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.553242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.553242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.553535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.568096] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: IN_PROGRESS for 2s [ 643.576896] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.577171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.578257] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.578257] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.578442] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.578605] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 33c55905-ffa9-49cf-a036-172dff9f2fa4 not found, creating... [ 643.579056] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.579366] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.579567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.580184] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.580414] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.580770] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.581019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.581163] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.581385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.581517] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.581657] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 33c55905-ffa9-49cf-a036-172dff9f2fa4 is going to be created. [ 643.633195] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.633435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.633503] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.633893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.634189] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.634518] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.312668] env[65080]: INFO networking_nsxv3.common.synchronization [req-24847ca8-d902-42bc-acf6-e23795bdcfef req-532e506f-a579-4a9c-b6ee-641391063188 service nova] Enqueued Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_rules [ 644.312903] env[65080]: INFO networking_nsxv3.common.synchronization [req-24847ca8-d902-42bc-acf6-e23795bdcfef req-532e506f-a579-4a9c-b6ee-641391063188 service nova] Enqueued Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 644.313058] env[65080]: INFO networking_nsxv3.common.synchronization [req-24847ca8-d902-42bc-acf6-e23795bdcfef req-532e506f-a579-4a9c-b6ee-641391063188 service nova] Enqueued Resource ID: 33c55905-ffa9-49cf-a036-172dff9f2fa4 with Priority: HIGHEST for action port [ 644.313636] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_rules [ 644.313812] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 644.314304] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c55905-ffa9-49cf-a036-172dff9f2fa4 with Priority: HIGHEST for action port [ 644.314707] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.314889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.314964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.315326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.315441] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.316620] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.316779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.316887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.317058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.317230] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.317337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.317402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.317644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.317644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.317765] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.318978] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c55905-ffa9-49cf-a036-172dff9f2fa4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.319140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.319214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.319485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.319544] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c55905-ffa9-49cf-a036-172dff9f2fa4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.478084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 644.478368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.478368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.478593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.478684] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.822134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.822292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.827228] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.827228] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c55905-ffa9-49cf-a036-172dff9f2fa4 with status ACTIVE [ 644.827228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.827228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.827228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.827228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.827228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.827228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.827228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.827571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.827571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.827571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.827660] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.828276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.828276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.828276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.830733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.830733] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c55905-ffa9-49cf-a036-172dff9f2fa4 is going to be updated. [ 644.857259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.857259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.857259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.857259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.857259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.857259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c55905-ffa9-49cf-a036-172dff9f2fa4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.983151] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.983491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.983491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.985576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.985852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.986059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.986159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.986454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.987333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.987333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.987333] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.333181] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.404481] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.404481] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.404481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.404481] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.489685] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.490043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.490043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.490581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.490581] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.490581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.490581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.490777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.490777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.490848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.490956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.491055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.491113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.491672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.491672] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.491672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.491672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.491672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.491904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.491904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.491904] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.580524] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: SUCCESS [ 645.580854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.838061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.838265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.838318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.839142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.839142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.839380] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 is going to be created. [ 645.866971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.866971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.866971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.867267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.867267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.878321] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: UNINITIALIZED for 2s [ 645.908057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.908552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.908886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.909234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.911109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.911109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.911109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.911632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.911632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.911632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.911632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.911632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.911632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.911893] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.943325] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c421167-6e02-4266-be00-0c987445ae23 req-cf80c306-9f85-46f5-9555-ae7229b8b02f tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: c09b680e-9b24-4c89-9432-3260d3556a25 with Priority: HIGHEST for action security_group_rules [ 645.943821] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09b680e-9b24-4c89-9432-3260d3556a25 with Priority: HIGHEST for action security_group_rules [ 645.944245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c09b680e-9b24-4c89-9432-3260d3556a25 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.944390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c09b680e-9b24-4c89-9432-3260d3556a25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c09b680e-9b24-4c89-9432-3260d3556a25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.944857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c09b680e-9b24-4c89-9432-3260d3556a25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.944927] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c09b680e-9b24-4c89-9432-3260d3556a25',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.997477] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 368f5d0c-dc76-4d4f-b69c-1d60821659c2: rpc.has_security_group_logging(os_id): False [ 646.014788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.014788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.015036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.015087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.015173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.015369] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.015465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.015529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.016062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.016062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.016062] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.016062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.016062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.016264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.016304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.016468] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.016554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.016610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.016752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.017065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.020284] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 646.110292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.110292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.110292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.110677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.111080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.124766] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 646.415376] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354ecbf4-79a8-4770-9da4-7284d1f205e7: rpc.has_security_group_logging(os_id): False [ 646.437048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437625] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.439684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be created. [ 646.475253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.475253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.475253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.475253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.475253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.475253] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c09b680e-9b24-4c89-9432-3260d3556a25 already deleted. [ 646.475253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c09b680e-9b24-4c89-9432-3260d3556a25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.530450] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.530860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.530860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.530952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.531064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.543205] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 646.911431] env[65080]: INFO networking_nsxv3.common.synchronization [req-7d06a9d0-f2ca-4685-84bf-c29502298874 req-89887a48-7332-4b57-8d0b-6936795785a1 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 646.912288] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 646.912827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.913157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.913459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.913824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.914186] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.914465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.914662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.914967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.915222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.915448] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.048508] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9c727f06-2589-4dde-b13b-a5d679d96c1d None None] Enqueued Resource ID: a8836927-b4d2-400f-9563-67817fe96973 with Priority: HIGHEST for action port [ 647.049379] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8836927-b4d2-400f-9563-67817fe96973 with Priority: HIGHEST for action port [ 647.049716] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8836927-b4d2-400f-9563-67817fe96973 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.049864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8836927-b4d2-400f-9563-67817fe96973" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.049926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8836927-b4d2-400f-9563-67817fe96973" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.050273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8836927-b4d2-400f-9563-67817fe96973" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.050378] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8836927-b4d2-400f-9563-67817fe96973',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.395655] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.395816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.395960] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.396229] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.396484] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.396638] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.396751] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.396957] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.397235] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.397446] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.397617] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.397748] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.397937] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.398088] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.398194] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.398322] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.418821] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.419043] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.420464] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.420464] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-791" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.420464] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.420464] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.420464] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.420464] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.420464] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.421584] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.553211] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8836927-b4d2-400f-9563-67817fe96973 [ 647.553211] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.553211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.553211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.554749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.554749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.554749] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8836927-b4d2-400f-9563-67817fe96973 already deleted. [ 647.554749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8836927-b4d2-400f-9563-67817fe96973" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.890397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: SUCCESS [ 647.891141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.891293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.891363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.891566] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.891680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.891744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.891944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.892105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.892227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.892297] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.924348] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.924584] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.924839] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.925683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.925683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.925683] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 not found, creating... [ 647.925683] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.925926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.925926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.926908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.926908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.926908] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.926908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.926908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.927328] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.927328] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.927328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 is going to be created. [ 647.928379] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.952512] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.952752] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.953018] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.953410] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.953848] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.954228] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.140341] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 648.140669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.394592] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.394759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.394828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.395099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.395567] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.395567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.395567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.395745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.395745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.395905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.395905] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.396073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.396073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.396225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.396366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.396453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.396531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.396650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.396747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.396828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.396905] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.433043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.433282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.433282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.433899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.433899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.433899] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 648.464720] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.464877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.464952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.465207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.465360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.476478] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 648.558073] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 648.558574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.675494] env[65080]: INFO networking_nsxv3.common.synchronization [req-7d06a9d0-f2ca-4685-84bf-c29502298874 req-733798dc-215f-4675-9b18-13e4cdb93ceb service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 648.675494] env[65080]: INFO networking_nsxv3.common.synchronization [req-7d06a9d0-f2ca-4685-84bf-c29502298874 req-733798dc-215f-4675-9b18-13e4cdb93ceb service nova] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 648.675494] env[65080]: INFO networking_nsxv3.common.synchronization [req-7d06a9d0-f2ca-4685-84bf-c29502298874 req-733798dc-215f-4675-9b18-13e4cdb93ceb service nova] Enqueued Resource ID: 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 with Priority: HIGHEST for action port [ 648.675494] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_rules [ 648.676160] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 648.676160] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 with Priority: HIGHEST for action port [ 648.676160] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.676912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.676993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.677248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.677365] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.678607] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.678703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.678905] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.680272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.680272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.680272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.680272] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.899927] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6825ea0a-b872-4921-b4ff-cfadbcf5f615: rpc.has_security_group_logging(os_id): False [ 648.922026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.922026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.922026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.922026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.922761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.922761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.922858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.923107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.923194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.923677] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 is going to be created. [ 648.991516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.991761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.991761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.992322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.992430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.005577] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: IN_PROGRESS for 2s [ 649.182149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.182359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.182580] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 with status ACTIVE [ 649.182825] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.183246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.183246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.184652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.184769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.189643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.189643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.189643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.189643] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6 is going to be updated. [ 649.221806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.221806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.221806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.221806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.221806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.221806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e894cfe-3fb3-487a-bed2-76a1bfbb9cd6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.263516] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5a6c7d9a-98c7-47e1-8ea0-9b612a7471df None None] Enqueued Resource ID: 288f450c-77b5-4124-aad5-cbd5d72abfa6 with Priority: HIGHEST for action port [ 649.263681] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 288f450c-77b5-4124-aad5-cbd5d72abfa6 with Priority: HIGHEST for action port [ 649.264212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-288f450c-77b5-4124-aad5-cbd5d72abfa6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.264212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-288f450c-77b5-4124-aad5-cbd5d72abfa6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.264399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-288f450c-77b5-4124-aad5-cbd5d72abfa6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.264505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-288f450c-77b5-4124-aad5-cbd5d72abfa6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.264938] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('288f450c-77b5-4124-aad5-cbd5d72abfa6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.772576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 288f450c-77b5-4124-aad5-cbd5d72abfa6 [ 649.772576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.772576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.772576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.772576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.772576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.772576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:288f450c-77b5-4124-aad5-cbd5d72abfa6 already deleted. [ 649.772576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-288f450c-77b5-4124-aad5-cbd5d72abfa6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.179375] env[65080]: INFO networking_nsxv3.common.synchronization [None req-62a149d1-5be6-447c-bb58-fff95648e98c None None] Enqueued Resource ID: b9818321-8f42-4b12-974b-3ea149b14eda with Priority: HIGHEST for action port [ 650.179944] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9818321-8f42-4b12-974b-3ea149b14eda with Priority: HIGHEST for action port [ 650.180428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9818321-8f42-4b12-974b-3ea149b14eda taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.180428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9818321-8f42-4b12-974b-3ea149b14eda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.180552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9818321-8f42-4b12-974b-3ea149b14eda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.180825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9818321-8f42-4b12-974b-3ea149b14eda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.180915] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9818321-8f42-4b12-974b-3ea149b14eda',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.356290] env[65080]: INFO networking_nsxv3.common.synchronization [req-5cd45969-f6e2-428b-adf9-5c713406718c req-d2c1896f-70dc-4cd4-9339-881bb25d8b68 tempest-ImagesNegativeTestJSON-1128363570 tempest-ImagesNegativeTestJSON-1128363570-project-member] Enqueued Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 650.358348] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 650.358670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.358799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.358867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.359140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.359299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.359465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.359465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.359608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.359760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.359805] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.490360] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.490360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.490360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.491023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.491023] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.684532] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9818321-8f42-4b12-974b-3ea149b14eda [ 650.685436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.685436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.685436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.685436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.685436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685708] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9818321-8f42-4b12-974b-3ea149b14eda already deleted. [ 650.685708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9818321-8f42-4b12-974b-3ea149b14eda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.864797] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.864797] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.864797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.866440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.866440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.866440] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469659aa-55ee-4417-af33-cbcc618456d1 already deleted. [ 650.866440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.892720] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.892720] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-64" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.892979] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-64" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.896070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-64" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.896070] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.896070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.896070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.896070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.896070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.896070] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.896070] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.896070] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.896070] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.896608] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.896608] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.896676] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.920170] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.920419] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.920607] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.921029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-64" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.921321] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-156a8c37-026d-4acc-8082-56a5a0557204 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.921897] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.921970] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.922783] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.924146] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('156a8c37-026d-4acc-8082-56a5a0557204',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.997917] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.019966] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: SUCCESS [ 651.019966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.393269] env[65080]: INFO networking_nsxv3.common.synchronization [None req-1393ed89-1a5b-4e14-9fd5-d59547b9cb41 None None] Enqueued Resource ID: c065ab84-e0e8-4db7-b220-09914a8e4cda with Priority: HIGHEST for action port [ 651.393552] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c065ab84-e0e8-4db7-b220-09914a8e4cda with Priority: HIGHEST for action port [ 651.393928] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c065ab84-e0e8-4db7-b220-09914a8e4cda taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.394048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c065ab84-e0e8-4db7-b220-09914a8e4cda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.395339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c065ab84-e0e8-4db7-b220-09914a8e4cda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.395339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c065ab84-e0e8-4db7-b220-09914a8e4cda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.395339] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c065ab84-e0e8-4db7-b220-09914a8e4cda',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.430537] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.430537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.430537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.430537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.430537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.430537] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 156a8c37-026d-4acc-8082-56a5a0557204 not found, creating... [ 651.431447] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.432177] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.432459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.433143] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.433500] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.434027] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.434312] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.434594] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.436043] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.436043] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.436043] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 156a8c37-026d-4acc-8082-56a5a0557204 is going to be created. [ 651.461292] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.461292] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.461529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.461895] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.462171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.462411] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.500154] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.899757] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c065ab84-e0e8-4db7-b220-09914a8e4cda [ 651.899757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.900296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.900296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.900402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.900572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.900813] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c065ab84-e0e8-4db7-b220-09914a8e4cda already deleted. [ 651.901105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c065ab84-e0e8-4db7-b220-09914a8e4cda" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.003897] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.004168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.004231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.006090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.006090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.006090] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 652.045719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.045719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.045870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.046035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.046597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.063330] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 652.273059] env[65080]: INFO networking_nsxv3.common.synchronization [req-5cd45969-f6e2-428b-adf9-5c713406718c req-233d2be6-1c56-4fb8-a078-e0dbf4da9354 service nova] Enqueued Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_rules [ 652.273262] env[65080]: INFO networking_nsxv3.common.synchronization [req-5cd45969-f6e2-428b-adf9-5c713406718c req-233d2be6-1c56-4fb8-a078-e0dbf4da9354 service nova] Enqueued Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 652.273411] env[65080]: INFO networking_nsxv3.common.synchronization [req-5cd45969-f6e2-428b-adf9-5c713406718c req-233d2be6-1c56-4fb8-a078-e0dbf4da9354 service nova] Enqueued Resource ID: 156a8c37-026d-4acc-8082-56a5a0557204 with Priority: HIGHEST for action port [ 652.273992] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_rules [ 652.274237] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 652.274410] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156a8c37-026d-4acc-8082-56a5a0557204 with Priority: HIGHEST for action port [ 652.274781] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.274868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.275240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.275240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.275452] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.282341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.282341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.282341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.282341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.282341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.282341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.282341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.282650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.282650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.282650] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.283622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-156a8c37-026d-4acc-8082-56a5a0557204 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.283833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.283833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.283986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.289082] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('156a8c37-026d-4acc-8082-56a5a0557204',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.790544] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.795178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.795178] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 156a8c37-026d-4acc-8082-56a5a0557204 with status ACTIVE [ 652.795178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.795178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.795178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.797651] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.797983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.798211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.799055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.799055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.799325] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 156a8c37-026d-4acc-8082-56a5a0557204 is going to be updated. [ 652.824873] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.825836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.825836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.825836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.825836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.826158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-156a8c37-026d-4acc-8082-56a5a0557204" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.116066] env[65080]: INFO networking_nsxv3.common.synchronization [req-e91b902c-47e6-4f20-95a4-b58af49f0ea9 req-b30d646c-ba15-469b-b5a4-8f5c0c0f6789 tempest-DeleteServersAdminTestJSON-1263296383 tempest-DeleteServersAdminTestJSON-1263296383-project-member] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 653.116801] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 653.118342] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.118480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.118563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.118827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.119113] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.119293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.119369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.119523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.120526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.120526] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.295306] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.359921] env[65080]: INFO networking_nsxv3.common.synchronization [None req-e7b1c126-40d6-4c2e-be81-bfd037f93794 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 653.360445] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 653.360815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.360977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.361362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.361362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.361674] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.622462] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.625588] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.625588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.625588] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be updated. [ 653.654664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.654887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.655165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.655384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.664775] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 653.674850] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.675072] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.675220] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.675484] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.675732] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.675904] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.676029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.676237] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.676373] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.676573] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.676680] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.676782] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.676948] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.677019] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.677113] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.677236] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.695585] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.695736] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.695898] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.696080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.696383] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.696550] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.696663] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.696985] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.697156] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64c7696-9ecf-4ddc-80bf-8862ab6ee34b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.798568] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.798913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.798913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799475] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469659aa-55ee-4417-af33-cbcc618456d1 is going to be created. [ 653.828256] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.828472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.828585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.828941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.829223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.840296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: UNINITIALIZED for 2s [ 653.884136] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.884662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.884662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.884662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.884662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.884895] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 already deleted. [ 653.884895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.963640] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6624a471-243c-4e5f-a3b6-c0deea1daf7d tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 653.964270] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 653.964575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.965414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.965414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.965414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.965414] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.083022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 654.083335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.083465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.083673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.086521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.086719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.086797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.086996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.087108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.087206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.087435] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.199531] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.199851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.199896] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.200191] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.200335] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.200484] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port d64c7696-9ecf-4ddc-80bf-8862ab6ee34b not found, creating... [ 654.200768] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.200945] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.201079] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.201296] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.201423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.201691] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.201838] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.201947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.202162] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.202300] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.202437] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: d64c7696-9ecf-4ddc-80bf-8862ab6ee34b is going to be created. [ 654.223168] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.223370] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.223502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.223802] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.223985] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.224229] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.492455] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.492697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.492697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.493017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.493125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.493230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 already deleted. [ 654.493342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.564939] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6a495cc0-d0ea-4534-ba57-b2c94e97eb53 None None] Enqueued Resource ID: d208433a-3ce1-4578-8398-0c76997c9c0a with Priority: HIGHEST for action port [ 654.565421] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d208433a-3ce1-4578-8398-0c76997c9c0a with Priority: HIGHEST for action port [ 654.565724] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d208433a-3ce1-4578-8398-0c76997c9c0a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.566036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d208433a-3ce1-4578-8398-0c76997c9c0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.566036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d208433a-3ce1-4578-8398-0c76997c9c0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.566408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d208433a-3ce1-4578-8398-0c76997c9c0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.566616] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d208433a-3ce1-4578-8398-0c76997c9c0a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.594076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.595334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.595486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.597057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.597057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.597057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.597057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.597574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.597574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.597574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.597574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.597574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.597574] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [req-e91b902c-47e6-4f20-95a4-b58af49f0ea9 req-801315c3-f935-4880-b131-15b36af80521 service nova] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_rules [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [req-e91b902c-47e6-4f20-95a4-b58af49f0ea9 req-801315c3-f935-4880-b131-15b36af80521 service nova] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [req-e91b902c-47e6-4f20-95a4-b58af49f0ea9 req-801315c3-f935-4880-b131-15b36af80521 service nova] Enqueued Resource ID: d64c7696-9ecf-4ddc-80bf-8862ab6ee34b with Priority: HIGHEST for action port [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_rules [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 654.991575] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d64c7696-9ecf-4ddc-80bf-8862ab6ee34b with Priority: HIGHEST for action port [ 654.991575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.991575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.991575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.991575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.991575] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.992752] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.992898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.993245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.993349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.993415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.993590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.993664] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d64c7696-9ecf-4ddc-80bf-8862ab6ee34b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.075259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d208433a-3ce1-4578-8398-0c76997c9c0a [ 655.075259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.075259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.075259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.075259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.075259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.075259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d208433a-3ce1-4578-8398-0c76997c9c0a already deleted. [ 655.075259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d208433a-3ce1-4578-8398-0c76997c9c0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.100405] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 368f5d0c-dc76-4d4f-b69c-1d60821659c2: rpc.has_security_group_logging(os_id): False [ 655.120360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.120550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.120600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.120913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.120913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.121056] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.121668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.121668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.121668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.121668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.121668] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.121668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.121932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.121932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.121932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.122230] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.122230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.125670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.126027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.126027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.126136] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 655.187969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.187969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.188197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.188197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.188418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.202065] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 655.497599] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.497599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.501048] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d64c7696-9ecf-4ddc-80bf-8862ab6ee34b with status ACTIVE [ 655.501048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.501243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.501243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.501460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.501509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.501688] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.501790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.501855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.502088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.502274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.502368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.502643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.502739] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d64c7696-9ecf-4ddc-80bf-8862ab6ee34b is going to be updated. [ 655.526676] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.526676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.526676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.526676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.526676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.526676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d64c7696-9ecf-4ddc-80bf-8862ab6ee34b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.677637] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 655.678183] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b deletion is rescheduled due to dependency. [ 655.678359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.678550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.678771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.679022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.679098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.679912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.680447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.680447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.680447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.776143] env[65080]: INFO networking_nsxv3.common.synchronization [req-86bde22e-95f2-43ce-89a8-469623870001 req-ddf25bc4-5d0b-40e0-8812-703286fcdc8f tempest-ServersTestFqdnHostnames-872778182 tempest-ServersTestFqdnHostnames-872778182-project-member] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 655.776431] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 655.776929] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.777274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.777447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.777856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.778636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.778903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.779107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.783021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.783021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.783021] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.852531] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: SUCCESS [ 655.852941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.853607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.853866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.854120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.854256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.854383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.855045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.855286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.855608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.855940] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.183440] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.266921] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.267813] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-364" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.267813] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-364" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.268246] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-364" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.268639] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.268810] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.268917] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.269533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.269533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.269773] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.269904] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.270040] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.270167] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.270282] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.270389] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.270518] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.278333] env[65080]: INFO networking_nsxv3.common.synchronization [req-bc2fad88-2070-4abd-804a-786c64627c76 req-6d8545e6-7754-49d5-bb61-02537c6194af tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: 4425e1da-0886-4c20-a365-7675442c0088 with Priority: HIGHEST for action security_group_rules [ 656.278851] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4425e1da-0886-4c20-a365-7675442c0088 with Priority: HIGHEST for action security_group_rules [ 656.279192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4425e1da-0886-4c20-a365-7675442c0088 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.279322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4425e1da-0886-4c20-a365-7675442c0088" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.279391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4425e1da-0886-4c20-a365-7675442c0088" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.279924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4425e1da-0886-4c20-a365-7675442c0088" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.279924] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4425e1da-0886-4c20-a365-7675442c0088',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.283603] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.284155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.284155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.284776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.284776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.284776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.284949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.285029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.285904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.286053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.286692] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce already deleted. [ 656.286692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.293440] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.293638] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.293853] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.294175] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-364" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.294416] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.294690] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.294777] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.295140] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.295279] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aae0b7e-da30-492c-a4a8-ec8e703da6d4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.358444] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.358941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.359086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.359326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.359530] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.359869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.359869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.360584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.360584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.360584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.360806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.361739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.361894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.362091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.362299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.362438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.362523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.362736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.362781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.362901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.363035] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.685442] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.797811] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.798353] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.798595] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.799149] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.799456] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.799733] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 not found, creating... [ 656.800156] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.800567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.800848] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.801205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.801545] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.801990] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.802318] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.802634] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.803050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.803297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.803575] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 is going to be created. [ 656.805783] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.806095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.806257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.806829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.807077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.807442] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4425e1da-0886-4c20-a365-7675442c0088 already deleted. [ 656.807662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4425e1da-0886-4c20-a365-7675442c0088" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.833658] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.833658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.833658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.833658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.833658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.833658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.850378] env[65080]: INFO networking_nsxv3.common.synchronization [None req-f38f027d-253a-48c3-a6fb-6d578859d7e9 None None] Enqueued Resource ID: 8fe6bd71-2278-4417-a36f-1547423ac828 with Priority: HIGHEST for action port [ 656.850378] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe6bd71-2278-4417-a36f-1547423ac828 with Priority: HIGHEST for action port [ 656.850378] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe6bd71-2278-4417-a36f-1547423ac828 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.850701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe6bd71-2278-4417-a36f-1547423ac828" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.850945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe6bd71-2278-4417-a36f-1547423ac828" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.851594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe6bd71-2278-4417-a36f-1547423ac828" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.851779] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe6bd71-2278-4417-a36f-1547423ac828',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.866042] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 469659aa-55ee-4417-af33-cbcc618456d1: rpc.has_security_group_logging(os_id): False [ 656.885896] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.886606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.886606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.886762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.886876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.887192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.888544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.888544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.888544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.888544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.888544] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.888544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.888931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.889188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.889300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.889536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.890123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.890123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.890123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.890123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.890123] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 469659aa-55ee-4417-af33-cbcc618456d1 is going to be created. [ 656.978545] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.978773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.978891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.979237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.979491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.990227] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: IN_PROGRESS for 2s [ 657.189860] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.189860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.189860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.189860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.189860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.189860] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be updated. [ 657.231894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 657.232305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.248659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.248888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.248888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.249370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.249370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.261378] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 657.353980] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fe6bd71-2278-4417-a36f-1547423ac828 [ 657.354351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.354433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.354492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.354680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.354780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.354875] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fe6bd71-2278-4417-a36f-1547423ac828 already deleted. [ 657.354963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe6bd71-2278-4417-a36f-1547423ac828" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.600076] env[65080]: INFO networking_nsxv3.common.synchronization [req-86bde22e-95f2-43ce-89a8-469623870001 req-44ab256e-b17d-4e38-835b-179b37088480 service nova] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 657.600365] env[65080]: INFO networking_nsxv3.common.synchronization [req-86bde22e-95f2-43ce-89a8-469623870001 req-44ab256e-b17d-4e38-835b-179b37088480 service nova] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 657.600566] env[65080]: INFO networking_nsxv3.common.synchronization [req-86bde22e-95f2-43ce-89a8-469623870001 req-44ab256e-b17d-4e38-835b-179b37088480 service nova] Enqueued Resource ID: 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 with Priority: HIGHEST for action port [ 657.603395] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_rules [ 657.603395] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 657.603395] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 with Priority: HIGHEST for action port [ 657.603395] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.603395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.603395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.603395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.604533] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.605820] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.605888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.606036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.608063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.608063] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.608063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.608063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.608689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.608689] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aae0b7e-da30-492c-a4a8-ec8e703da6d4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.110333] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.111363] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.111531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.111621] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 with status ACTIVE [ 658.112020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.112020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.112020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.112245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.112245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.112894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.112894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.112894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.112894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.112894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.113292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.114148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.114148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.114148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.114148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.114148] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aae0b7e-da30-492c-a4a8-ec8e703da6d4 is going to be updated. [ 658.134836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.135042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.135042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.135311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.135447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.135818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aae0b7e-da30-492c-a4a8-ec8e703da6d4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.165946] env[65080]: INFO networking_nsxv3.common.synchronization [req-d30df911-88c7-4f8c-909b-2d256890ecdc req-c50a05d9-5d38-448e-a6db-26d467017967 tempest-InstanceActionsV221TestJSON-2050316211 tempest-InstanceActionsV221TestJSON-2050316211-project-member] Enqueued Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 658.166456] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 658.166763] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.166952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.166988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.167272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.167460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.167668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.167790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.167887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.168185] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.616260] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.670702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.671041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.671041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.671290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.671389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.671598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.671708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.671773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.671938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.672030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.672141] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d already deleted. [ 658.672198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.702361] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.702575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-135" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.703164] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-135" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.703164] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-135" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.703359] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.703535] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.703657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.703913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.704103] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704318] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.704423] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.704524] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.704628] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.704752] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.704965] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.705087] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.725777] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.726027] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.726243] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.726456] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-135" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.726781] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-88b354a4-cded-4ffa-8185-de6aa39a3162 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.727012] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.727146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.727497] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.727653] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88b354a4-cded-4ffa-8185-de6aa39a3162',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.005703] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: SUCCESS [ 659.005931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.121917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.122171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.122414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.122765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.122962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.123129] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce is going to be created. [ 659.154282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.154282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.154282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.154282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.154504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.166280] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: UNINITIALIZED for 2s [ 659.229921] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.230203] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.230672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.231450] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.231643] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.231837] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 88b354a4-cded-4ffa-8185-de6aa39a3162 not found, creating... [ 659.232233] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.232445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.232599] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.232919] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.233258] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.233654] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.233874] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.234039] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.234859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.235081] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.235204] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 88b354a4-cded-4ffa-8185-de6aa39a3162 is going to be created. [ 659.265419] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.265785] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.266252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.266379] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.266775] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.267119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.287406] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 659.287725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.288298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.288602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.288878] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.289115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.289281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.289538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.289685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.289844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.290045] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.792432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.792952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.792952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.792952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.793414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.793414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.793414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.793626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.793626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.793626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.793762] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.793813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.793865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.794120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.794256] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.794350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.794415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.794541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.794613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.794695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.794856] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.131688] env[65080]: INFO networking_nsxv3.common.synchronization [req-d30df911-88c7-4f8c-909b-2d256890ecdc req-3aedcd2c-21cb-4365-a56f-006146d6a47d service nova] Enqueued Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_rules [ 660.131927] env[65080]: INFO networking_nsxv3.common.synchronization [req-d30df911-88c7-4f8c-909b-2d256890ecdc req-3aedcd2c-21cb-4365-a56f-006146d6a47d service nova] Enqueued Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 660.132142] env[65080]: INFO networking_nsxv3.common.synchronization [req-d30df911-88c7-4f8c-909b-2d256890ecdc req-3aedcd2c-21cb-4365-a56f-006146d6a47d service nova] Enqueued Resource ID: 88b354a4-cded-4ffa-8185-de6aa39a3162 with Priority: HIGHEST for action port [ 660.133016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_rules [ 660.133161] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 660.133297] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b354a4-cded-4ffa-8185-de6aa39a3162 with Priority: HIGHEST for action port [ 660.133662] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.133875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.133934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.134292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134424] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.135979] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.135979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.136240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.136456] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.136585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.136731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.136961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.137103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.137205] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.138281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-88b354a4-cded-4ffa-8185-de6aa39a3162 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.138471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.138601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.138881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.138932] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88b354a4-cded-4ffa-8185-de6aa39a3162',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.297464] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5db4dff-67d7-4cc9-a39d-74b1615f620b: rpc.has_security_group_logging(os_id): False [ 660.324319] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.324319] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.324319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.324969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.324969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.324969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.324969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.324969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.325281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.325281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.326345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.326751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.326868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.327030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.327170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.327267] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be updated. [ 660.403494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.403717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.403717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.403937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.404121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.423991] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 660.641664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.641911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.642196] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.643331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88b354a4-cded-4ffa-8185-de6aa39a3162 with status ACTIVE [ 660.643545] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.643670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.643738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.643982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.644048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.644239] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.644343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.644405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.644562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.644640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.644827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.644921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.644982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.649034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.649034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.649034] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88b354a4-cded-4ffa-8185-de6aa39a3162 is going to be updated. [ 660.677784] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.678921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.678921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.678921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.678921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.679228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88b354a4-cded-4ffa-8185-de6aa39a3162" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.148743] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.178540] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: SUCCESS [ 661.178815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.179438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.179685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.179930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.180080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.180172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.180353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.180489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.180570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.180668] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.222628] env[65080]: INFO networking_nsxv3.common.synchronization [req-c258584b-5cc6-4636-a60a-518b39da9da8 req-eff7ae44-ccb8-405d-8261-2bcc6f5b3215 tempest-ImagesOneServerTestJSON-821953684 tempest-ImagesOneServerTestJSON-821953684-project-member] Enqueued Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 661.223279] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 661.223587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.224202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.224282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.224538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.224720] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.224857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.224925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.225076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.225180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.225180] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.653051] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.653051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.653051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.653051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.654014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.655998] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d is going to be created. [ 661.682822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.683278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.683454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.684014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.684312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.685644] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.698804] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: UNINITIALIZED for 2s [ 661.703754] env[65080]: INFO networking_nsxv3.common.synchronization [None req-900a20e6-f12b-45ba-8b85-e199835a36ad None None] Enqueued Resource ID: ba57d554-141c-4a21-ad39-94caab0dd31e with Priority: HIGHEST for action port [ 661.704361] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba57d554-141c-4a21-ad39-94caab0dd31e with Priority: HIGHEST for action port [ 661.704676] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba57d554-141c-4a21-ad39-94caab0dd31e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.704805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba57d554-141c-4a21-ad39-94caab0dd31e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.704872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba57d554-141c-4a21-ad39-94caab0dd31e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.707164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba57d554-141c-4a21-ad39-94caab0dd31e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.707164] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba57d554-141c-4a21-ad39-94caab0dd31e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.728466] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.728578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.728651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.728900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.728996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.729272] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.729357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.729397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.729592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.729592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.729696] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 already deleted. [ 661.729774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.927204] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.928670] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.928670] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.929631] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.930378] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.930541] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.931261] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.931261] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.931524] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.931785] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.932086] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.932241] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.932353] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.932565] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.932696] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.933029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.957799] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.957931] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.960392] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.960392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.960392] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-6b1def4e-270a-4838-a00d-3833a3d4cb07 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.960392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.960392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.960392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.960392] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b1def4e-270a-4838-a00d-3833a3d4cb07',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.188496] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2aca6290-771b-45ff-a84d-6dbf408cedce: rpc.has_security_group_logging(os_id): False [ 662.209767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba57d554-141c-4a21-ad39-94caab0dd31e [ 662.209767] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.209767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.209767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.210316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.210316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.210316] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba57d554-141c-4a21-ad39-94caab0dd31e already deleted. [ 662.210435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba57d554-141c-4a21-ad39-94caab0dd31e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.216165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.216165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.216165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.216165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.216492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.216554] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.216620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.216674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.216856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.216927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.217021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce is going to be created. [ 662.519995] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.519995] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: IN_PROGRESS for 2s [ 662.519995] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.519995] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.519995] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 6b1def4e-270a-4838-a00d-3833a3d4cb07 not found, creating... [ 662.522127] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.522127] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.522127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.523955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 6b1def4e-270a-4838-a00d-3833a3d4cb07 is going to be created. [ 662.523955] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.523955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.523955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.523955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.523955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.523955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.291666] env[65080]: INFO networking_nsxv3.common.synchronization [req-c258584b-5cc6-4636-a60a-518b39da9da8 req-394bd2f0-46d3-4695-99bb-a2f3bf8df9bd service nova] Enqueued Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_rules [ 663.292117] env[65080]: INFO networking_nsxv3.common.synchronization [req-c258584b-5cc6-4636-a60a-518b39da9da8 req-394bd2f0-46d3-4695-99bb-a2f3bf8df9bd service nova] Enqueued Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 663.292117] env[65080]: INFO networking_nsxv3.common.synchronization [req-c258584b-5cc6-4636-a60a-518b39da9da8 req-394bd2f0-46d3-4695-99bb-a2f3bf8df9bd service nova] Enqueued Resource ID: 6b1def4e-270a-4838-a00d-3833a3d4cb07 with Priority: HIGHEST for action port [ 663.292568] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_rules [ 663.292730] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 663.292839] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b1def4e-270a-4838-a00d-3833a3d4cb07 with Priority: HIGHEST for action port [ 663.296303] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.296523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.296615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.296876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.296979] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.298990] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.298990] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.298990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.298990] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.300830] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b1def4e-270a-4838-a00d-3833a3d4cb07 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.300830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.301074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.301143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.301209] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b1def4e-270a-4838-a00d-3833a3d4cb07',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.709632] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: SUCCESS [ 663.709900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.710139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.710393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.710604] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.710743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.710828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.711040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.711121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.711223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.711336] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.803732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.803732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.803732] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.804607] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b1def4e-270a-4838-a00d-3833a3d4cb07 with status ACTIVE [ 663.804847] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.804977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.805346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.805487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.805679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.805818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.806478] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.806584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.806657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.807020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.807124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b1def4e-270a-4838-a00d-3833a3d4cb07 is going to be updated. [ 663.831312] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.831579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.831676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.832011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.832257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.832631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b1def4e-270a-4838-a00d-3833a3d4cb07" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.083691] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6c7f43a2-25e6-4e5e-97f3-dd9bf0a300ee None None] Enqueued Resource ID: 7dd1735e-e72d-41e8-b17e-a53517a9a495 with Priority: HIGHEST for action port [ 664.084379] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd1735e-e72d-41e8-b17e-a53517a9a495 with Priority: HIGHEST for action port [ 664.084722] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dd1735e-e72d-41e8-b17e-a53517a9a495 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.084868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dd1735e-e72d-41e8-b17e-a53517a9a495" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.084939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dd1735e-e72d-41e8-b17e-a53517a9a495" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.085245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dd1735e-e72d-41e8-b17e-a53517a9a495" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.085333] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dd1735e-e72d-41e8-b17e-a53517a9a495',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.213694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.213971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.214055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.214934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.215249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.215687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.215687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.215831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.215939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.216094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.216327] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.216489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.216587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.216827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.218464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.218464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.218464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.218464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.218464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.218464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.218464] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.309118] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.393674] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: SUCCESS [ 664.393943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.588057] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dd1735e-e72d-41e8-b17e-a53517a9a495 [ 664.588425] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.588654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.588899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.589127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.589307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.589472] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dd1735e-e72d-41e8-b17e-a53517a9a495 already deleted. [ 664.589626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dd1735e-e72d-41e8-b17e-a53517a9a495" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.721781] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f49306d-9b39-4971-a2bc-404227491c8d: rpc.has_security_group_logging(os_id): False [ 664.753086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.753086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.753086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.753086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.754584] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.754584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.754584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.754584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.754584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.754584] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d is going to be created. [ 664.813679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.813679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.813679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.813921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.813921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.814063] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 is going to be created. [ 664.851238] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.851238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.851238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.851435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.851852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.853916] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.854083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.854083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.854282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.854987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.872084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: UNINITIALIZED for 2s [ 664.873097] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: IN_PROGRESS for 2s [ 665.381787] env[65080]: INFO networking_nsxv3.common.synchronization [None req-88934edc-c023-4b34-a0c8-de9b7be8aa0a None None] Enqueued Resource ID: 4e243298-391a-4bbc-a531-b57c173d88b2 with Priority: HIGHEST for action port [ 665.382668] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e243298-391a-4bbc-a531-b57c173d88b2 with Priority: HIGHEST for action port [ 665.383209] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e243298-391a-4bbc-a531-b57c173d88b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.383567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e243298-391a-4bbc-a531-b57c173d88b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.383747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e243298-391a-4bbc-a531-b57c173d88b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.384141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e243298-391a-4bbc-a531-b57c173d88b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.384506] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e243298-391a-4bbc-a531-b57c173d88b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.794063] env[65080]: INFO networking_nsxv3.common.synchronization [req-f5c26f26-fbf9-4851-9ae1-611696f468d3 req-fa1f6a1c-f606-4643-beed-1a1f8e87be9e tempest-AttachInterfacesV270Test-1282610680 tempest-AttachInterfacesV270Test-1282610680-project-member] Enqueued Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 665.795122] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 665.795122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.795314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.795542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.795854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.796033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.796161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.796225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.796702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.796702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.796852] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.888118] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e243298-391a-4bbc-a531-b57c173d88b2 [ 665.888380] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.888750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.888750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.889372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.889372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.889372] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e243298-391a-4bbc-a531-b57c173d88b2 already deleted. [ 665.889372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e243298-391a-4bbc-a531-b57c173d88b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.226582] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c4885db8-9680-4a49-ae5e-4a593f241104 None None] Enqueued Resource ID: 3aa9841a-333f-44d0-9e8e-e981af70e8b3 with Priority: HIGHEST for action port [ 666.229936] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aa9841a-333f-44d0-9e8e-e981af70e8b3 with Priority: HIGHEST for action port [ 666.229936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aa9841a-333f-44d0-9e8e-e981af70e8b3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.230924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aa9841a-333f-44d0-9e8e-e981af70e8b3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.230924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aa9841a-333f-44d0-9e8e-e981af70e8b3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.231140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aa9841a-333f-44d0-9e8e-e981af70e8b3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.231193] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa9841a-333f-44d0-9e8e-e981af70e8b3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.299758] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.299887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.299984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.300181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.300271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.301166] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.303810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.303960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.304234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.304349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.304464] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 already deleted. [ 666.304584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.396904] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-638 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.397669] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-638" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.397942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-638" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.399051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-638" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.399051] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.399051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.399051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.399380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.399380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.399483] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.399542] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.399717] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.399805] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.399903] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.400139] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.400257] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.422798] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.423055] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.423307] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.423931] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-638" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.423931] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-23117bc4-c9e8-43b4-8530-053f1ec0b29c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.423931] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.424146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.424753] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.424753] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23117bc4-c9e8-43b4-8530-053f1ec0b29c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.737934] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aa9841a-333f-44d0-9e8e-e981af70e8b3 [ 666.738206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.738354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.738444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.738691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.738786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.738898] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aa9841a-333f-44d0-9e8e-e981af70e8b3 already deleted. [ 666.738987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aa9841a-333f-44d0-9e8e-e981af70e8b3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.888511] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: SUCCESS [ 666.888754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.888928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.889943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.889943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.889943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.889943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.889943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.889943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.890265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.890746] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.893170] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: SUCCESS [ 666.893686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.927897] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.927897] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.928181] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.928342] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.928493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.928668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 23117bc4-c9e8-43b4-8530-053f1ec0b29c not found, creating... [ 666.928996] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929206] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929344] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.930347] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.930347] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.930347] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.930347] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.930642] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.930642] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.930764] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.930931] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 23117bc4-c9e8-43b4-8530-053f1ec0b29c is going to be created. [ 666.956412] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.956412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.956412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.956657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.959843] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.959843] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.396774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.396774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.396774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.396774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.397823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.397823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.397892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.398268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.398379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.398994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.398994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.398994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.398994] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.747822] env[65080]: INFO networking_nsxv3.common.synchronization [req-f5c26f26-fbf9-4851-9ae1-611696f468d3 req-b18bce2a-5d60-47cb-a5d1-74950248c9e2 service nova] Enqueued Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_rules [ 667.747991] env[65080]: INFO networking_nsxv3.common.synchronization [req-f5c26f26-fbf9-4851-9ae1-611696f468d3 req-b18bce2a-5d60-47cb-a5d1-74950248c9e2 service nova] Enqueued Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 667.748142] env[65080]: INFO networking_nsxv3.common.synchronization [req-f5c26f26-fbf9-4851-9ae1-611696f468d3 req-b18bce2a-5d60-47cb-a5d1-74950248c9e2 service nova] Enqueued Resource ID: 23117bc4-c9e8-43b4-8530-053f1ec0b29c with Priority: HIGHEST for action port [ 667.749029] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_rules [ 667.749180] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 667.749300] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23117bc4-c9e8-43b4-8530-053f1ec0b29c with Priority: HIGHEST for action port [ 667.749765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.750051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.750051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.750536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.750643] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.752206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.752528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.752611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.752805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.753161] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.753294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.753988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.753988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.753988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.753988] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.754749] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-23117bc4-c9e8-43b4-8530-053f1ec0b29c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.754858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.754926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.755132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.755417] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23117bc4-c9e8-43b4-8530-053f1ec0b29c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.905726] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dfe941e-e110-4be2-8d6d-f400f514d0e5: rpc.has_security_group_logging(os_id): False [ 667.931164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.931418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.931469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.932061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.932061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.932252] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.932396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.932485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.932776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.932903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.934041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.934315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.934315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.935905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.935905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.935905] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.935905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.936177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.936217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.936425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.936425] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 is going to be created. [ 668.009880] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.010065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.010154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.010373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.010546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.026631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: IN_PROGRESS for 2s [ 668.259326] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.263801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.263944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.280943] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c70e8673-28c5-4a6c-8bbf-7d33d4d8a924 None None] Enqueued Resource ID: 083ccd6c-86ad-4e09-a866-65004589fa03 with Priority: HIGHEST for action port [ 668.281969] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083ccd6c-86ad-4e09-a866-65004589fa03 with Priority: HIGHEST for action port [ 668.282974] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-083ccd6c-86ad-4e09-a866-65004589fa03 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.283175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-083ccd6c-86ad-4e09-a866-65004589fa03" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.283253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-083ccd6c-86ad-4e09-a866-65004589fa03" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.283546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-083ccd6c-86ad-4e09-a866-65004589fa03" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.283635] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('083ccd6c-86ad-4e09-a866-65004589fa03',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.347142] env[65080]: INFO networking_nsxv3.common.synchronization [req-04bbc0aa-936a-4ced-8a2c-ecd020738299 req-1d3c9c0f-d9d3-48b6-aa05-706fe95d13ac tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 668.347768] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 668.349233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.349373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.349426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.349705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.349864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.349967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.350039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.350974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.350974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.350974] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.765299] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23117bc4-c9e8-43b4-8530-053f1ec0b29c with status ACTIVE [ 668.765704] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.765704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.765820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.766018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.766148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.766414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.766575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.766645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.766823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.766905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.767175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.767256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.767295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.768153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.768153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.768153] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23117bc4-c9e8-43b4-8530-053f1ec0b29c is going to be updated. [ 668.770896] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.785773] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 083ccd6c-86ad-4e09-a866-65004589fa03 [ 668.786573] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.786573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.786573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.786913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.786913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.786913] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:083ccd6c-86ad-4e09-a866-65004589fa03 already deleted. [ 668.787157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-083ccd6c-86ad-4e09-a866-65004589fa03" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.794438] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.794600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.794656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.794865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.794997] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.795179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23117bc4-c9e8-43b4-8530-053f1ec0b29c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.823247] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.823613] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.823804] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.824280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.825198] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.825405] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.825600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.825933] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.826171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.826472] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.826654] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.826818] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.826969] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.827203] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.827291] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.827466] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.850010] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.850010] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.850221] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.850258] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.850551] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-bcb919b0-b1f3-40d1-ac19-10f6a8989632 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.850867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.850867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.851170] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.851293] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb919b0-b1f3-40d1-ac19-10f6a8989632',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.852346] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.852452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.852452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.852621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.852699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.852872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.852991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.853066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.853224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.854951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.854951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf already deleted. [ 668.854951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.274207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.274207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.274207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.274207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.274818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.274818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 is going to be created. [ 669.308846] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.308992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.309085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.309376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.309532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.313466] env[65080]: INFO networking_nsxv3.common.synchronization [None req-95439bdc-1a6f-475d-823d-8ef3e1003946 None None] Enqueued Resource ID: fbf90f37-8ba7-405c-930e-b69ed7eac037 with Priority: HIGHEST for action port [ 669.314990] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf90f37-8ba7-405c-930e-b69ed7eac037 with Priority: HIGHEST for action port [ 669.314990] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf90f37-8ba7-405c-930e-b69ed7eac037 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.315191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf90f37-8ba7-405c-930e-b69ed7eac037" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.315191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf90f37-8ba7-405c-930e-b69ed7eac037" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.315568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf90f37-8ba7-405c-930e-b69ed7eac037" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.315695] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf90f37-8ba7-405c-930e-b69ed7eac037',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.323734] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: UNINITIALIZED for 2s [ 669.355230] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.355520] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.355651] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.355930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.356112] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.356264] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port bcb919b0-b1f3-40d1-ac19-10f6a8989632 not found, creating... [ 669.356545] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.356729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.356808] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.357061] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.357202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.357493] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.357637] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.357819] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.358126] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.358674] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.358674] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: bcb919b0-b1f3-40d1-ac19-10f6a8989632 is going to be created. [ 669.385027] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.385027] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.385027] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.385673] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.386319] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.386319] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.818484] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbf90f37-8ba7-405c-930e-b69ed7eac037 [ 669.822356] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.822356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.822356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.822579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.822667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.822768] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbf90f37-8ba7-405c-930e-b69ed7eac037 already deleted. [ 669.822843] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf90f37-8ba7-405c-930e-b69ed7eac037" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.042432] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: SUCCESS [ 670.043180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.196764] env[65080]: INFO networking_nsxv3.common.synchronization [req-04bbc0aa-936a-4ced-8a2c-ecd020738299 req-99276b05-feb5-495a-a76b-84e39025d049 service nova] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 670.196764] env[65080]: INFO networking_nsxv3.common.synchronization [req-04bbc0aa-936a-4ced-8a2c-ecd020738299 req-99276b05-feb5-495a-a76b-84e39025d049 service nova] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 670.196764] env[65080]: INFO networking_nsxv3.common.synchronization [req-04bbc0aa-936a-4ced-8a2c-ecd020738299 req-99276b05-feb5-495a-a76b-84e39025d049 service nova] Enqueued Resource ID: bcb919b0-b1f3-40d1-ac19-10f6a8989632 with Priority: HIGHEST for action port [ 670.197160] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_rules [ 670.197301] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 670.197399] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb919b0-b1f3-40d1-ac19-10f6a8989632 with Priority: HIGHEST for action port [ 670.200199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.200199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.200199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.200199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.200564] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.201236] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.201236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.201489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.201489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.201601] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.201698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.201800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.201895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.201979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.202830] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.202830] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb919b0-b1f3-40d1-ac19-10f6a8989632 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.203149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.203811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.204098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.204306] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb919b0-b1f3-40d1-ac19-10f6a8989632',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.652933] env[65080]: INFO networking_nsxv3.common.synchronization [req-eca1d982-1f15-418d-a4ea-0e9c6218510a req-5cbf6d88-88d5-42f9-ba0c-00ec01b04e31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 670.653559] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 670.653840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.654159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.654159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.654407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.654570] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.654690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.654751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.655058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.655058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.655058] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.707130] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb919b0-b1f3-40d1-ac19-10f6a8989632 with status ACTIVE [ 670.707289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.707363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.708918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.708918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.708918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.708918] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb919b0-b1f3-40d1-ac19-10f6a8989632 is going to be updated. [ 670.710994] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.710994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.710994] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.741596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.741596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.741596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.741596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.741596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.741596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb919b0-b1f3-40d1-ac19-10f6a8989632" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.814269] env[65080]: INFO networking_nsxv3.common.synchronization [req-1f037823-ab71-4396-bcec-bbe3f61b6958 req-003d1372-00a5-465d-83e1-91c7c6d3fb45 tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: e7ae70fe-b207-41a4-bc8a-23f14759f8c5 with Priority: HIGHEST for action security_group_rules [ 670.814678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ae70fe-b207-41a4-bc8a-23f14759f8c5 with Priority: HIGHEST for action security_group_rules [ 670.815713] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7ae70fe-b207-41a4-bc8a-23f14759f8c5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.816056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7ae70fe-b207-41a4-bc8a-23f14759f8c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.816132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7ae70fe-b207-41a4-bc8a-23f14759f8c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.816410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7ae70fe-b207-41a4-bc8a-23f14759f8c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.816489] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7ae70fe-b207-41a4-bc8a-23f14759f8c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.949144] env[65080]: INFO networking_nsxv3.common.synchronization [None req-f02b04cc-c01a-4ca5-a013-d0d87e4baed6 None None] Enqueued Resource ID: 56b1f7ac-aafd-4a8d-ace4-24568314f13b with Priority: HIGHEST for action port [ 670.949660] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b1f7ac-aafd-4a8d-ace4-24568314f13b with Priority: HIGHEST for action port [ 670.949977] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-56b1f7ac-aafd-4a8d-ace4-24568314f13b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.950121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56b1f7ac-aafd-4a8d-ace4-24568314f13b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.950187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56b1f7ac-aafd-4a8d-ace4-24568314f13b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.950480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56b1f7ac-aafd-4a8d-ace4-24568314f13b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.950574] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56b1f7ac-aafd-4a8d-ace4-24568314f13b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.157358] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.157504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.157576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.157791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.157882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.158082] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.158276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.158340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.158500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.158580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.158669] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 already deleted. [ 671.158749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.159753] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.159912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.160057] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.160318] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.160567] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.160716] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.160824] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.161331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.161522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.161753] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.161860] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.161973] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.162098] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.162343] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.162343] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.162430] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.185093] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.185451] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.185704] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.186163] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.186299] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-b802bca7-53c8-4a32-bd47-dd9247f9189b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.186509] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.186654] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.186997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.187149] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b802bca7-53c8-4a32-bd47-dd9247f9189b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.212837] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.334306] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: SUCCESS [ 671.334676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.335409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.335662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.335871] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.336307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.336415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.336577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.336658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.336831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.336915] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.346137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.346137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.346137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.346137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.346137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.346137] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7ae70fe-b207-41a4-bc8a-23f14759f8c5 already deleted. [ 671.346137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7ae70fe-b207-41a4-bc8a-23f14759f8c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.452623] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56b1f7ac-aafd-4a8d-ace4-24568314f13b [ 671.452889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.453072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.453145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.453375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.453465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.453562] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56b1f7ac-aafd-4a8d-ace4-24568314f13b already deleted. [ 671.453644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56b1f7ac-aafd-4a8d-ace4-24568314f13b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.693375] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.693375] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port b802bca7-53c8-4a32-bd47-dd9247f9189b not found, creating... [ 671.693375] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.693375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.693926] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.693926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.693926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.695294] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.695456] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.695618] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: b802bca7-53c8-4a32-bd47-dd9247f9189b is going to be created. [ 671.715748] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.716316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.716564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.716975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.717633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.717633] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf is going to be created. [ 671.726411] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.728134] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.728134] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.728375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.729447] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.730111] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.755705] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.755705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.755705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.756124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.756124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.768531] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: UNINITIALIZED for 2s [ 671.844587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.847443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.847443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.847443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.848381] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.848381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.848381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.848381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.848381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.848381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.848607] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.351527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b73fffa1-5944-4b18-a4a3-4524859f2a56: rpc.has_security_group_logging(os_id): False [ 672.377904] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.377904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.377904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.378150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.378251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.378585] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.378585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.379408] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.379408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.379650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.379650] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.379726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.379922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.380017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.380101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 is going to be created. [ 672.511394] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.512090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.512090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.512090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.512090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.542846] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: IN_PROGRESS for 2s [ 672.579347] env[65080]: INFO networking_nsxv3.common.synchronization [req-eca1d982-1f15-418d-a4ea-0e9c6218510a req-f44f46b6-b24f-4f6c-b2c3-1a5c610e78f5 service nova] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 672.579635] env[65080]: INFO networking_nsxv3.common.synchronization [req-eca1d982-1f15-418d-a4ea-0e9c6218510a req-f44f46b6-b24f-4f6c-b2c3-1a5c610e78f5 service nova] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 672.579827] env[65080]: INFO networking_nsxv3.common.synchronization [req-eca1d982-1f15-418d-a4ea-0e9c6218510a req-f44f46b6-b24f-4f6c-b2c3-1a5c610e78f5 service nova] Enqueued Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 672.580861] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 672.581080] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 672.581226] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 672.581626] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.581888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.581888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.582296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.582415] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.584677] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.584677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.584830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.585093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.585288] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.585437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.585528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.586155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.586155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.586155] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.590025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b802bca7-53c8-4a32-bd47-dd9247f9189b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.590025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.590025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.590025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.590025] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b802bca7-53c8-4a32-bd47-dd9247f9189b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.081654] env[65080]: INFO networking_nsxv3.common.synchronization [req-96857109-6512-4113-a3b9-22b089a6369c req-7987f661-b74b-4e69-947b-f8530e7b5f3b tempest-ServerAddressesTestJSON-1962121823 tempest-ServerAddressesTestJSON-1962121823-project-member] Enqueued Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 673.082520] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 673.083352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.083352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.083352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.083675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.084015] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.084015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.084196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.084475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.084624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.084746] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.091374] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.092769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.093000] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.094058] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b802bca7-53c8-4a32-bd47-dd9247f9189b with status ACTIVE [ 673.094058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.094058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.094339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.094537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.094884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.094884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.094884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.095253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.095253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.095387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.096895] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.096895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.096895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.096895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.096895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.096895] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b802bca7-53c8-4a32-bd47-dd9247f9189b is going to be updated. [ 673.126304] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.126472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.126536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.126746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.126883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.127066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.552421] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.553627] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-696" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.553627] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-696" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.553627] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-696" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.553627] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.554731] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.554843] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.555980] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.556186] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.556422] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.556547] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.556662] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.556771] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.556882] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.556965] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.557105] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.578444] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.578444] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.578727] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.578727] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-696" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.579403] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-a1ca3f14-3485-490d-a133-7367e1f19327 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.579403] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.579403] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.579697] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.579697] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1ca3f14-3485-490d-a133-7367e1f19327',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.586879] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.587823] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.587823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.588102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.588102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.588102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d already deleted. [ 673.588102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.594894] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.769038] env[65080]: INFO networking_nsxv3.common.synchronization [None req-fba8a53a-5e6c-488e-99d8-f9715d5d216e None None] Enqueued Resource ID: e5d51963-7399-481d-862c-9123f56c2fae with Priority: HIGHEST for action port [ 673.770037] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d51963-7399-481d-862c-9123f56c2fae with Priority: HIGHEST for action port [ 673.770952] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d51963-7399-481d-862c-9123f56c2fae taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.770952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d51963-7399-481d-862c-9123f56c2fae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.770952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d51963-7399-481d-862c-9123f56c2fae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.771211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d51963-7399-481d-862c-9123f56c2fae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.771337] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d51963-7399-481d-862c-9123f56c2fae',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.780298] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: SUCCESS [ 673.780519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.780883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.780883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.781128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.781346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.781346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.781504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.781589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.781688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.781771] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.083781] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.084106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.084317] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.085362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.085362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.085362] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port a1ca3f14-3485-490d-a133-7367e1f19327 not found, creating... [ 674.085757] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.085757] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.085898] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.086811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.087052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.087494] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.087706] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.087859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.088162] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.088338] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.088518] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: a1ca3f14-3485-490d-a133-7367e1f19327 is going to be created. [ 674.098504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.098504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.098504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.098847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.098847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.098955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be created. [ 674.112854] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.113309] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.113522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.113763] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.114119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.114477] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.127908] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.128051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.128097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.128300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.128500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.145266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: UNINITIALIZED for 2s [ 674.273827] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5d51963-7399-481d-862c-9123f56c2fae [ 674.273827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.274270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.274270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.274375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.274426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.274530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5d51963-7399-481d-862c-9123f56c2fae already deleted. [ 674.274613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d51963-7399-481d-862c-9123f56c2fae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.287876] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.567754] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: SUCCESS [ 674.568102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.792783] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4afef2a-fdec-49a9-a48d-5d83f81fd8bf: rpc.has_security_group_logging(os_id): False [ 674.819178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.819608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.819848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.820244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.820407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.820856] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.821204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.821393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.821690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.821989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.822198] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf is going to be created. [ 674.899413] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.899413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.899413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.899413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.899858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.913567] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: IN_PROGRESS for 2s [ 674.996410] env[65080]: INFO networking_nsxv3.common.synchronization [req-96857109-6512-4113-a3b9-22b089a6369c req-00e2b9da-ea6d-42cb-b7e4-b872e4f97eac service nova] Enqueued Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_rules [ 674.996613] env[65080]: INFO networking_nsxv3.common.synchronization [req-96857109-6512-4113-a3b9-22b089a6369c req-00e2b9da-ea6d-42cb-b7e4-b872e4f97eac service nova] Enqueued Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 674.996760] env[65080]: INFO networking_nsxv3.common.synchronization [req-96857109-6512-4113-a3b9-22b089a6369c req-00e2b9da-ea6d-42cb-b7e4-b872e4f97eac service nova] Enqueued Resource ID: a1ca3f14-3485-490d-a133-7367e1f19327 with Priority: HIGHEST for action port [ 674.997372] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_rules [ 674.997613] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 674.997805] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ca3f14-3485-490d-a133-7367e1f19327 with Priority: HIGHEST for action port [ 674.997933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.998149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.998149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.998429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.998523] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.999459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.999618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.999798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.999846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.000018] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.000350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.000350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.000350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.000591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.000591] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.001397] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1ca3f14-3485-490d-a133-7367e1f19327 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.001553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.001620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.001755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.001804] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1ca3f14-3485-490d-a133-7367e1f19327',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.503856] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.504039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.504194] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.505093] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1ca3f14-3485-490d-a133-7367e1f19327 with status ACTIVE [ 675.505295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.505437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.505555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.505703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.505782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.505958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.506083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.506215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.506306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.506405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.506560] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.506998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.512091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.512403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.512530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.512687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1ca3f14-3485-490d-a133-7367e1f19327 is going to be updated. [ 675.541531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.541727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.541727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.541944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.542336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.542519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1ca3f14-3485-490d-a133-7367e1f19327" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.678266] env[65080]: INFO networking_nsxv3.common.synchronization [req-355afb27-9d5d-449b-85af-6c87af9dfc3d req-1ff8294f-5949-45a3-bda9-410b1463ec6f tempest-ImagesNegativeTestJSON-1128363570 tempest-ImagesNegativeTestJSON-1128363570-project-member] Enqueued Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 675.681886] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469659aa-55ee-4417-af33-cbcc618456d1 with Priority: HIGHEST for action security_group_members [ 675.682848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-469659aa-55ee-4417-af33-cbcc618456d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.685251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.685251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.685251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.685251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.685251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.685251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.685820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.685820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.685820] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469659aa-55ee-4417-af33-cbcc618456d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.015424] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.128490] env[65080]: INFO networking_nsxv3.common.synchronization [req-fda64c3e-fe4b-42e4-b64d-731f90f1ca1b req-86504124-ab19-44a3-986b-5b66e9c474b8 tempest-InstanceActionsV221TestJSON-2050316211 tempest-InstanceActionsV221TestJSON-2050316211-project-member] Enqueued Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 676.130446] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGHEST for action security_group_members [ 676.131193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.131367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.131847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.132120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.132958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.134739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.134739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.134895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.134992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.135115] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.161072] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.163559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.163559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.163559] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.192078] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.192078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.192255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.192349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.192652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.192652] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.192837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.192837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.192990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.192990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.193361] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469659aa-55ee-4417-af33-cbcc618456d1 is going to be updated. [ 676.229338] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.229574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.229627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.230490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.230490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.240040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: IN_PROGRESS for 2s [ 676.519687] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.519859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.519907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.520155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.520261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.520358] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d is going to be created. [ 676.546489] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.546489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.546489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.546803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.547046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.560049] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: UNINITIALIZED for 2s [ 676.637602] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.637713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.637776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.637967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.638066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.638276] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.638382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.638448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.638869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.638869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.638869] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d is going to be updated. [ 676.665704] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.665868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.665980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.666196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.666378] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.666490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.666552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.666751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.666881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.666950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.667108] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.667220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.667293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.667426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.667565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.667726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.667726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.667893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.667977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.668097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.668161] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.669792] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.670098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.670098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.670227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.670330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.681780] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: IN_PROGRESS for 2s [ 676.933917] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: SUCCESS [ 676.933917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.115186] env[65080]: INFO networking_nsxv3.common.synchronization [req-899288d1-1b23-41de-8a97-cc3fcb0902c8 req-c5abfb9a-255b-49ee-a3ec-ac56fde5e6a7 tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: d33f4df7-ba82-4969-b83b-acac26ea37d8 with Priority: HIGHEST for action security_group_rules [ 677.115793] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33f4df7-ba82-4969-b83b-acac26ea37d8 with Priority: HIGHEST for action security_group_rules [ 677.123315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d33f4df7-ba82-4969-b83b-acac26ea37d8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.123315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d33f4df7-ba82-4969-b83b-acac26ea37d8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.123315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d33f4df7-ba82-4969-b83b-acac26ea37d8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.123315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d33f4df7-ba82-4969-b83b-acac26ea37d8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.123315] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d33f4df7-ba82-4969-b83b-acac26ea37d8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.174312] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 677.210420] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.210683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.210683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.211028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.211215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.211654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.211772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.211842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.212918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.213103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.213353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.213487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.213616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.213768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.213870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.215464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.215464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.215464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.216236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.216236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.216236] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be created. [ 677.331308] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.331536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.331536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.331672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.333045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.402755] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 677.669691] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.669691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.669691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.669948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.669948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.670038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d33f4df7-ba82-4969-b83b-acac26ea37d8 already deleted. [ 677.670113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d33f4df7-ba82-4969-b83b-acac26ea37d8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.265538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469659aa-55ee-4417-af33-cbcc618456d1 in Status: SUCCESS [ 678.266106] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469659aa-55ee-4417-af33-cbcc618456d1 deletion is rescheduled due to dependency. [ 678.266106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469659aa-55ee-4417-af33-cbcc618456d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.575542] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: SUCCESS [ 678.575884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.576102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.576396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.576670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.576847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.576962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.577238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.577366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.577730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.577730] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.699259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f49306d-9b39-4971-a2bc-404227491c8d in Status: SUCCESS [ 678.699573] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d deletion is rescheduled due to dependency. [ 678.699747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.823669] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5862030-1e3f-4294-ade4-7e18ef10036e req-c416db68-9c53-4885-889e-e480f9eaea49 tempest-ServersTestManualDisk-2013964951 tempest-ServersTestManualDisk-2013964951-project-member] Enqueued Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 678.825139] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 with Priority: HIGHEST for action security_group_members [ 678.825506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f37e842d-6cd4-418f-bbf9-d080ba3516d1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.825597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.825672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.826294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.826294] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.826294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.826294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.827220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.827220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.827220] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f37e842d-6cd4-418f-bbf9-d080ba3516d1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.083059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.083059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.083059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.083059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.083059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.085068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.085068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.085068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.085068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.085068] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.335164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.335593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.335593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.340041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.340041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.340041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 is going to be updated. [ 679.375890] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.376123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.376123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.377180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.377423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.395241] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: IN_PROGRESS for 2s [ 679.420069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 679.421197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.598775] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5205042a-83a4-497b-90f3-4c8bfbcc3a1d: rpc.has_security_group_logging(os_id): False [ 679.626526] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.627432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.627432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.627432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.627660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.628135] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.628135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.628135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.628498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.628498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.628691] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.628782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.628835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.629044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.629044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.629238] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.629334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.629413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.629622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.629712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.629842] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d is going to be created. [ 679.726168] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.726399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.726399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.726621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.726897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.750266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: IN_PROGRESS for 2s [ 680.681378] env[65080]: INFO networking_nsxv3.common.synchronization [req-c5c7fee7-ace3-4f85-b235-2f659fab6e84 req-01c1a983-f119-4a49-878a-73f4a0753546 tempest-InstanceActionsNegativeTestJSON-151070901 tempest-InstanceActionsNegativeTestJSON-151070901-project-member] Enqueued Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 680.681986] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 680.682415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.682526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.682584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.683095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.683311] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.683702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.683702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.683878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.683878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.683948] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.186613] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.186852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.186919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.187306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.187476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.187788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.187990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.187990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.188728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.188728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.188728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 409c4860-3410-423b-b6d1-e6ef10d36332 already deleted. [ 681.188728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.421042] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 in Status: SUCCESS [ 681.421307] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f37e842d-6cd4-418f-bbf9-d080ba3516d1 deletion is rescheduled due to dependency. [ 681.421436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f37e842d-6cd4-418f-bbf9-d080ba3516d1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.440410] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.440680] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-230" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.440836] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-230" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.445593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-230" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.447019] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.447019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.447019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.447019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.447019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.447364] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.447364] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.447497] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.447600] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.447747] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.447863] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.448038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.479579] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.479579] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.479579] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.479579] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-230" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.479579] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-adab706d-a3a4-4bff-9c40-6ea2d42284b6 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.479579] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.479579] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.480442] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.481571] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adab706d-a3a4-4bff-9c40-6ea2d42284b6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.764724] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: SUCCESS [ 681.765385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.983746] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.984099] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.984252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.984703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.984849] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.985082] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port adab706d-a3a4-4bff-9c40-6ea2d42284b6 not found, creating... [ 681.985488] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.985887] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.985887] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.989935] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.989935] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.990442] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.991813] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.992355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.992718] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.992911] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.993200] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: adab706d-a3a4-4bff-9c40-6ea2d42284b6 is going to be created. [ 682.018642] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.018866] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.019044] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.019433] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.019736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.020045] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.197946] env[65080]: INFO networking_nsxv3.common.synchronization [req-3602b795-3912-4c51-873e-851b10527569 req-c96e731f-3496-4c40-8dcd-e6a7db2da874 tempest-DeleteServersAdminTestJSON-1263296383 tempest-DeleteServersAdminTestJSON-1263296383-project-member] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 682.198768] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGHEST for action security_group_members [ 682.199126] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.199306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.199384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.199605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.199780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.199886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.199953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.200128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.200231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.200332] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.702972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.703210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.703293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.704058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.704195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.704433] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.704524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.704567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.704739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.704819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.704906] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be updated. [ 682.740122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.740445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.740445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.740778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.741164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.752323] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: IN_PROGRESS for 2s [ 682.784471] env[65080]: INFO networking_nsxv3.common.synchronization [req-c5c7fee7-ace3-4f85-b235-2f659fab6e84 req-25c195a3-1a87-4c45-864f-126344cf035d service nova] Enqueued Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_rules [ 682.784471] env[65080]: INFO networking_nsxv3.common.synchronization [req-c5c7fee7-ace3-4f85-b235-2f659fab6e84 req-25c195a3-1a87-4c45-864f-126344cf035d service nova] Enqueued Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 682.784471] env[65080]: INFO networking_nsxv3.common.synchronization [req-c5c7fee7-ace3-4f85-b235-2f659fab6e84 req-25c195a3-1a87-4c45-864f-126344cf035d service nova] Enqueued Resource ID: adab706d-a3a4-4bff-9c40-6ea2d42284b6 with Priority: HIGHEST for action port [ 682.785034] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_rules [ 682.785185] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 682.785353] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adab706d-a3a4-4bff-9c40-6ea2d42284b6 with Priority: HIGHEST for action port [ 682.786435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.786636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.786636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.786954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.787734] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.790571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.790571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.790571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.790571] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.790571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-adab706d-a3a4-4bff-9c40-6ea2d42284b6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.791573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.791573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.791573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.791573] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adab706d-a3a4-4bff-9c40-6ea2d42284b6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.296539] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.297446] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.297446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.297788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adab706d-a3a4-4bff-9c40-6ea2d42284b6 with status ACTIVE [ 683.297788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.299290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.299290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.299716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.299716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.303025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.303025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.303025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.303025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.303025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.303025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adab706d-a3a4-4bff-9c40-6ea2d42284b6 is going to be updated. [ 683.490623] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.490826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.490885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.491326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.491501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.491693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adab706d-a3a4-4bff-9c40-6ea2d42284b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.803732] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.306742] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.306935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.307208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.307354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.307446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.307554] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 409c4860-3410-423b-b6d1-e6ef10d36332 is going to be created. [ 684.346523] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.346523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.346523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.346523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.346523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.361254] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: UNINITIALIZED for 2s [ 684.625703] env[65080]: INFO networking_nsxv3.common.synchronization [req-556db031-2cca-44fe-ae4d-9517bc4ec266 req-1bd332b9-0e8b-4758-a939-8d416ca10fc7 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 684.626435] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 684.626772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.626930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.626989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.627251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.627412] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.627520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.627580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.627733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.627856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.627935] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.785957] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b in Status: SUCCESS [ 684.786200] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b deletion is rescheduled due to dependency. [ 684.786362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.130614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.131799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.131799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.131958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.132119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.132527] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.132669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.132731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.132958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.133125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.133234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 already deleted. [ 685.133290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.193029] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.193029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.193029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.193029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.193029] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.193796] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.194280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.198020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.198020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.198020] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.198020] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.198020] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.198020] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.198020] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.198020] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.198020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.231035] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.231193] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.231320] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.231755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.231929] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-a90edb44-09e8-4364-b950-b165526322ea taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.232162] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.232285] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.232693] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.232879] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90edb44-09e8-4364-b950-b165526322ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.562491] env[65080]: INFO networking_nsxv3.common.synchronization [None req-e7787db6-b21c-4316-aff8-7b829d4c6e88 None None] Enqueued Resource ID: 3aceb103-57d5-42af-897e-a47e75ece925 with Priority: HIGHEST for action port [ 685.563840] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aceb103-57d5-42af-897e-a47e75ece925 with Priority: HIGHEST for action port [ 685.565652] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aceb103-57d5-42af-897e-a47e75ece925 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.565652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aceb103-57d5-42af-897e-a47e75ece925" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.565652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aceb103-57d5-42af-897e-a47e75ece925" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.565652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aceb103-57d5-42af-897e-a47e75ece925" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.565652] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aceb103-57d5-42af-897e-a47e75ece925',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.735803] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.737989] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port a90edb44-09e8-4364-b950-b165526322ea not found, creating... [ 685.737989] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.737989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.738261] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.738423] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.738498] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.738605] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.738826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.738951] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.739125] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: a90edb44-09e8-4364-b950-b165526322ea is going to be created. [ 685.761204] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.761434] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.762656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.762656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.762656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.762656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.068971] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aceb103-57d5-42af-897e-a47e75ece925 [ 686.069226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.069372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.069425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.069703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.069813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.069921] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aceb103-57d5-42af-897e-a47e75ece925 already deleted. [ 686.070035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aceb103-57d5-42af-897e-a47e75ece925" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.373093] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: SUCCESS [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.375699] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.375699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.375699] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.526170] env[65080]: INFO networking_nsxv3.common.synchronization [req-556db031-2cca-44fe-ae4d-9517bc4ec266 req-51a12ff9-4afb-4570-b8a4-ebd2861e1566 service nova] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 686.526170] env[65080]: INFO networking_nsxv3.common.synchronization [req-556db031-2cca-44fe-ae4d-9517bc4ec266 req-51a12ff9-4afb-4570-b8a4-ebd2861e1566 service nova] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 686.526302] env[65080]: INFO networking_nsxv3.common.synchronization [req-556db031-2cca-44fe-ae4d-9517bc4ec266 req-51a12ff9-4afb-4570-b8a4-ebd2861e1566 service nova] Enqueued Resource ID: a90edb44-09e8-4364-b950-b165526322ea with Priority: HIGHEST for action port [ 686.526966] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_rules [ 686.527682] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 686.527810] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a90edb44-09e8-4364-b950-b165526322ea with Priority: HIGHEST for action port [ 686.528127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.528262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.528330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.528549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.529177] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.529639] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.529725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.529786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.530113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.530182] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.531118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.531118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.531118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.531118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.531118] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.534585] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a90edb44-09e8-4364-b950-b165526322ea taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.534675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.535057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.535057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.535057] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90edb44-09e8-4364-b950-b165526322ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.878505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.878732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.878732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.878967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.879156] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.879261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.879323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.879490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.879598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.879719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.879921] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.880036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.880101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.880282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.880447] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.880559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.880634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.880801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.880896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.881024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.881161] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.038566] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.039929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.039929] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.040374] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a90edb44-09e8-4364-b950-b165526322ea with status ACTIVE [ 687.040659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.040815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.040883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.041112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.041196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.041401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.041563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.041612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.042725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.042725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.042725] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a90edb44-09e8-4364-b950-b165526322ea is going to be updated. [ 687.067013] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.067200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.067259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.067504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.067638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.067809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a90edb44-09e8-4364-b950-b165526322ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.383418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 409c4860-3410-423b-b6d1-e6ef10d36332: rpc.has_security_group_logging(os_id): False [ 687.418153] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.418444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.418605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.419193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.419391] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.419559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.419670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.420324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.420804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.420916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.421476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.421476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.421629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.421769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.421895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.422142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.422290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.422445] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 409c4860-3410-423b-b6d1-e6ef10d36332 is going to be created. [ 687.517886] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.518098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.518098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.518333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.518523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.545205] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.569630] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: IN_PROGRESS for 2s [ 688.048808] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.049029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.049087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.049314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.049487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.049571] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 is going to be created. [ 688.083050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.083050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.083050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.083050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.083050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.094783] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: UNINITIALIZED for 2s [ 688.334352] env[65080]: INFO networking_nsxv3.common.synchronization [None req-0f2bfa8f-2bd7-4bdb-9005-3a44d626b892 None None] Enqueued Resource ID: f1da50bc-0b5f-4556-b2bc-56c03565830f with Priority: HIGHEST for action port [ 688.335230] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1da50bc-0b5f-4556-b2bc-56c03565830f with Priority: HIGHEST for action port [ 688.335611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1da50bc-0b5f-4556-b2bc-56c03565830f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.335754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1da50bc-0b5f-4556-b2bc-56c03565830f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.335824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1da50bc-0b5f-4556-b2bc-56c03565830f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.336137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1da50bc-0b5f-4556-b2bc-56c03565830f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.336249] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1da50bc-0b5f-4556-b2bc-56c03565830f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.571958] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d12290cc-6c9c-4317-a208-9cbf151ebd75 None None] Enqueued Resource ID: 8ca168b2-480a-4280-a40a-2a6410d6f86e with Priority: HIGHEST for action port [ 688.573184] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca168b2-480a-4280-a40a-2a6410d6f86e with Priority: HIGHEST for action port [ 688.573184] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ca168b2-480a-4280-a40a-2a6410d6f86e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.573184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ca168b2-480a-4280-a40a-2a6410d6f86e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.573409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ca168b2-480a-4280-a40a-2a6410d6f86e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.573500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ca168b2-480a-4280-a40a-2a6410d6f86e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.573559] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca168b2-480a-4280-a40a-2a6410d6f86e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.841595] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1da50bc-0b5f-4556-b2bc-56c03565830f [ 688.841843] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.842294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.842294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.842455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.842455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.843044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1da50bc-0b5f-4556-b2bc-56c03565830f already deleted. [ 688.843044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1da50bc-0b5f-4556-b2bc-56c03565830f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.997858] env[65080]: INFO networking_nsxv3.common.synchronization [req-cd2dafff-dea5-435a-b577-85102a18fc6d req-f40326cc-f6de-4911-b2b8-a272de956ec4 tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 688.998576] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 688.999156] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec25a1a8-e425-4143-b8c8-a3f74933498c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.999992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.999992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.999992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.999992] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec25a1a8-e425-4143-b8c8-a3f74933498c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.079556] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ca168b2-480a-4280-a40a-2a6410d6f86e [ 689.079556] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.079556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.079556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.079556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.079556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.079556] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ca168b2-480a-4280-a40a-2a6410d6f86e already deleted. [ 689.079556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ca168b2-480a-4280-a40a-2a6410d6f86e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.527441] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.527626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.527678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.528215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.528215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.528215] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec25a1a8-e425-4143-b8c8-a3f74933498c already deleted. [ 689.528215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.595497] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: SUCCESS [ 689.595791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.107729] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: SUCCESS [ 690.107729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.107810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.108085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.108227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.108876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.108876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.108876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.108876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.108876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.108876] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.611454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.950330] env[65080]: INFO networking_nsxv3.common.synchronization [req-609e03f3-1582-4676-87b5-ea46aa45f7bf req-247fae14-b0d2-4b4c-9cd0-12c8c1edfe78 tempest-ServersNegativeTestJSON-1863572029 tempest-ServersNegativeTestJSON-1863572029-project-member] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 690.955504] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 690.956498] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.956757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.956757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.957075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.957276] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.957393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.957457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.957644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.957738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.957841] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.114214] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0bed36f-2ea1-4c82-9859-63ef0d32d194: rpc.has_security_group_logging(os_id): False [ 691.140793] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.141105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.141243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.141581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.141721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.141979] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.142152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.142251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.142492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.142587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.142687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 is going to be created. [ 691.228031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.228031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.228031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.228031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.228031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.246755] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: IN_PROGRESS for 2s [ 691.430213] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.431019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.431019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.431019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.431545] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.434714] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.434714] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.434714] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.434714] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.434714] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.434714] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.434714] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.434714] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.434714] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.434714] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.434714] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.461236] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.461236] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.461236] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.461236] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.461236] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-2e08a414-e2c6-4c87-86bb-471e49e857c5 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.461874] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.462151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.462622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.462892] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e08a414-e2c6-4c87-86bb-471e49e857c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.464301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.464646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.464833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.465202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.465450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.467080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.467080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.467080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.467080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.467080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.467080] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b already deleted. [ 691.467080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.806212] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c58e9b92-c8c8-48b0-ace2-5123d2c39448 None None] Enqueued Resource ID: 0cfdfa7f-e8e6-460c-a034-b4db91b5edcf with Priority: HIGHEST for action port [ 691.808503] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfdfa7f-e8e6-460c-a034-b4db91b5edcf with Priority: HIGHEST for action port [ 691.808503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cfdfa7f-e8e6-460c-a034-b4db91b5edcf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.808503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cfdfa7f-e8e6-460c-a034-b4db91b5edcf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.808503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cfdfa7f-e8e6-460c-a034-b4db91b5edcf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.808503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cfdfa7f-e8e6-460c-a034-b4db91b5edcf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.808503] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cfdfa7f-e8e6-460c-a034-b4db91b5edcf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.970311] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.970311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.970311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.970311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.970311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.970311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 2e08a414-e2c6-4c87-86bb-471e49e857c5 not found, creating... [ 691.970311] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.970776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.970776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.971398] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.971575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.971909] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.972335] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.972476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.972741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.972893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.973047] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 is going to be created. [ 692.017310] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.017591] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.017725] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.018093] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.018300] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.020658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.108087] env[65080]: INFO networking_nsxv3.common.synchronization [None req-743f202a-6f00-4703-bd48-f604fda584ea None None] Enqueued Resource ID: 917ea9fd-2738-4376-ace5-fdd739a36b44 with Priority: HIGHEST for action port [ 692.108720] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917ea9fd-2738-4376-ace5-fdd739a36b44 with Priority: HIGHEST for action port [ 692.109122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-917ea9fd-2738-4376-ace5-fdd739a36b44 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.109519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917ea9fd-2738-4376-ace5-fdd739a36b44" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.109519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917ea9fd-2738-4376-ace5-fdd739a36b44" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.110176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917ea9fd-2738-4376-ace5-fdd739a36b44" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.110176] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917ea9fd-2738-4376-ace5-fdd739a36b44',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.310112] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cfdfa7f-e8e6-460c-a034-b4db91b5edcf [ 692.310355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.310498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.310791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.310887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.311018] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cfdfa7f-e8e6-460c-a034-b4db91b5edcf already deleted. [ 692.311199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cfdfa7f-e8e6-460c-a034-b4db91b5edcf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.612716] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 917ea9fd-2738-4376-ace5-fdd739a36b44 [ 692.612971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.613131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.613252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.613461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.613555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.613652] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:917ea9fd-2738-4376-ace5-fdd739a36b44 already deleted. [ 692.613738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917ea9fd-2738-4376-ace5-fdd739a36b44" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633052] env[65080]: INFO networking_nsxv3.common.synchronization [req-8f2d1c0e-38af-42c7-b8fb-d632e2d74255 req-2102e863-2a80-47a7-97d8-d1743cd8f3b4 tempest-AttachInterfacesV270Test-1282610680 tempest-AttachInterfacesV270Test-1282610680-project-member] Enqueued Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 692.633900] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 with Priority: HIGHEST for action security_group_members [ 692.634503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b73fffa1-5944-4b18-a4a3-4524859f2a56 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.634666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.634760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.635042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.635219] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.635359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.635449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.635636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.635760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.635906] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b73fffa1-5944-4b18-a4a3-4524859f2a56',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.730859] env[65080]: INFO networking_nsxv3.common.synchronization [req-609e03f3-1582-4676-87b5-ea46aa45f7bf req-0333879d-7953-4474-913e-a2f4b5818525 service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 692.731180] env[65080]: INFO networking_nsxv3.common.synchronization [req-609e03f3-1582-4676-87b5-ea46aa45f7bf req-0333879d-7953-4474-913e-a2f4b5818525 service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 692.731365] env[65080]: INFO networking_nsxv3.common.synchronization [req-609e03f3-1582-4676-87b5-ea46aa45f7bf req-0333879d-7953-4474-913e-a2f4b5818525 service nova] Enqueued Resource ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 with Priority: HIGHEST for action port [ 692.732078] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 692.732254] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 692.732358] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 with Priority: HIGHEST for action port [ 692.732665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.732837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.732937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.733374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.733545] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.735174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.735174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.735174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.735326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.736306] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.736306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.736306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.736306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.736306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.736306] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.737385] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e08a414-e2c6-4c87-86bb-471e49e857c5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.737506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.737737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.737737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.737824] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e08a414-e2c6-4c87-86bb-471e49e857c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.015168] env[65080]: INFO networking_nsxv3.common.synchronization [req-d47bc741-6e4c-46f6-942f-390097eff1cf req-5a380a25-ab24-4947-ab81-8512d2eaff84 tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 693.015760] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 693.016084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.016212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.016296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.016505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.016660] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.016759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.016822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.016978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.017086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.017171] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.141064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.141064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.141064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.141064] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 is going to be updated. [ 693.180169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.180266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.180337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.180570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.180722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.194831] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: IN_PROGRESS for 2s [ 693.242019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.242019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.242019] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.242492] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e08a414-e2c6-4c87-86bb-471e49e857c5 with status ACTIVE [ 693.242699] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.242823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.242887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.243190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.243286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.243477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.244646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.244646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.244646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.244646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.244780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.248271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.248271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.248271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.248271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.248271] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 is going to be updated. [ 693.263966] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: SUCCESS [ 693.263966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.274299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.274299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.274299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.274299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.274299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.274783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.520963] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.523481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.523481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.525222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.525222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.525222] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be updated. [ 693.569385] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.569385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.569385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.569385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.569385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.581968] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 693.628889] env[65080]: INFO networking_nsxv3.common.synchronization [req-12aaa3b3-955b-4893-a327-64fa08dd2cc3 req-86a4d22b-6c1d-4421-9870-2e5b90c82580 tempest-VolumesAdminNegativeTest-1276364567 tempest-VolumesAdminNegativeTest-1276364567-project-member] Enqueued Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 693.629114] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 693.629449] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.629934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.629934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.629934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.630577] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.630577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.630577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.630577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.630577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.630577] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.751138] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.107775] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-597 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.108270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-597" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.108270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-597" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.108849] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-597" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.109122] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.109349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.109624] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.109823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.110017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.110301] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.110494] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.110577] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.110639] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.110805] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.110893] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.111132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.133881] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.134066] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.134197] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.134473] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-597" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.134738] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-5f947a83-0cb8-4184-9241-35a8167eca09 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.134907] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.135030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.135363] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.135533] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f947a83-0cb8-4184-9241-35a8167eca09',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.136558] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.136720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.136762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.136940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.137044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.137280] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.137396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.137500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.137613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.137686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.137773] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 already deleted. [ 694.137851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.254512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.254512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.254512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.255115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.255115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.255115] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be created. [ 694.283512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.283746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.283746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.283921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.284087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.305427] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: UNINITIALIZED for 2s [ 694.641183] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.641183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.641183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.641183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.641183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.641183] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 5f947a83-0cb8-4184-9241-35a8167eca09 not found, creating... [ 694.641183] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.642217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.642217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.642217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.642217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.642645] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.642831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.643042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.643352] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.643705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.643854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 5f947a83-0cb8-4184-9241-35a8167eca09 is going to be created. [ 694.672361] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.672361] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.672361] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.672361] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.672636] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.673268] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.700351] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 694.700643] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 694.701489] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 694.701715] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 694.702432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.702432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.702432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.702793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.704330] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.704330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.704330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.704330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.704330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.704330] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.706760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.706760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.706760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.706760] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.765447] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 694.765646] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 694.765742] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_rules [ 694.765862] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 694.765985] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf4c2f9f-535f-493c-ac5c-5c6356bb0db9 req-c6b0175a-03e4-4126-bc2e-9a30f77c4677 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 694.768378] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 694.768571] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_rules [ 694.768626] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 694.768733] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 694.768815] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 694.769146] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.769264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.769438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.770116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.770116] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.771831] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.771831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.771831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.773979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.774125] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.775424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b802bca7-53c8-4a32-bd47-dd9247f9189b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.775572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.775654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.775969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.776406] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b802bca7-53c8-4a32-bd47-dd9247f9189b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.780120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.780120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.780120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.780120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.017829] env[65080]: INFO networking_nsxv3.common.synchronization [req-22bbc08f-04d6-49e4-8bc7-fa267ecbeb93 req-78775438-4239-45f2-afe5-386336b61524 tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 695.021432] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 695.021432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec25a1a8-e425-4143-b8c8-a3f74933498c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.021432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.021432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.021432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.021432] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec25a1a8-e425-4143-b8c8-a3f74933498c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.140376] env[65080]: INFO networking_nsxv3.common.synchronization [None req-31afb5cc-78d5-44de-a6d6-1fbb602f4dc0 None None] Enqueued Resource ID: cd49d264-c190-4457-bb67-991aa6c56ab0 with Priority: HIGHEST for action port [ 695.140805] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49d264-c190-4457-bb67-991aa6c56ab0 with Priority: HIGHEST for action port [ 695.141203] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd49d264-c190-4457-bb67-991aa6c56ab0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.141810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd49d264-c190-4457-bb67-991aa6c56ab0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.141810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd49d264-c190-4457-bb67-991aa6c56ab0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.141810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd49d264-c190-4457-bb67-991aa6c56ab0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.141810] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd49d264-c190-4457-bb67-991aa6c56ab0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.206946] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 in Status: SUCCESS [ 695.206946] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b73fffa1-5944-4b18-a4a3-4524859f2a56 deletion is rescheduled due to dependency. [ 695.207090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b73fffa1-5944-4b18-a4a3-4524859f2a56" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.209460] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.209915] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.282109] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b802bca7-53c8-4a32-bd47-dd9247f9189b with status ACTIVE [ 695.282109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.282109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.282109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.282516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.282516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.282516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.282599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.283341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.283341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.283341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.283341] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b802bca7-53c8-4a32-bd47-dd9247f9189b is going to be updated. [ 695.284876] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.284979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.285357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.285454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.332485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.332692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.332692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.333248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.333248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.333469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [req-12aaa3b3-955b-4893-a327-64fa08dd2cc3 req-27c229ac-8f85-481d-b864-ea0b16de00a9 service nova] Enqueued Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_rules [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [req-12aaa3b3-955b-4893-a327-64fa08dd2cc3 req-27c229ac-8f85-481d-b864-ea0b16de00a9 service nova] Enqueued Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [req-12aaa3b3-955b-4893-a327-64fa08dd2cc3 req-27c229ac-8f85-481d-b864-ea0b16de00a9 service nova] Enqueued Resource ID: 5f947a83-0cb8-4184-9241-35a8167eca09 with Priority: HIGHEST for action port [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_rules [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 695.473067] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f947a83-0cb8-4184-9241-35a8167eca09 with Priority: HIGHEST for action port [ 695.473067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.473067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.473067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.474167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.474246] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.479473] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.479903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.480065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.481039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.481392] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.481586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.481703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.481979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.483038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.483038] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.489162] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f947a83-0cb8-4184-9241-35a8167eca09 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.489162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.489162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.489162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.489162] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f947a83-0cb8-4184-9241-35a8167eca09',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.546477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.546477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.546726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.546766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.546857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.546953] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec25a1a8-e425-4143-b8c8-a3f74933498c already deleted. [ 695.547046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.595371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 695.595371] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 deletion is rescheduled due to dependency. [ 695.595371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.645791] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd49d264-c190-4457-bb67-991aa6c56ab0 [ 695.645791] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.645791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.645791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.646560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.646560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.646560] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd49d264-c190-4457-bb67-991aa6c56ab0 already deleted. [ 695.646560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd49d264-c190-4457-bb67-991aa6c56ab0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.713472] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.714338] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.992052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.994087] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f947a83-0cb8-4184-9241-35a8167eca09 with status ACTIVE [ 695.994087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.994087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.994087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.994087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.994087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.994087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.994087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.994588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.996985] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.996985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.996985] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f947a83-0cb8-4184-9241-35a8167eca09 is going to be updated. [ 695.997465] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.997588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.021393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.022529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.023300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.023300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.023300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.023300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f947a83-0cb8-4184-9241-35a8167eca09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.218194] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.218469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.218502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.218726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.218810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.218968] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be created. [ 696.220509] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.220858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.220858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.222277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.222277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.222277] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 696.250308] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.250308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.250407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.250762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.251611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.258537] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.258692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.259422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.259422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.259422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.263584] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: UNINITIALIZED for 2s [ 696.268533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 696.340647] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 696.340898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.341088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.341330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.341528] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.341639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.341709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.341867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.341971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.342086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.342173] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.498410] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.844345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.844536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.844578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.844872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.845082] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.845201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.845278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.845463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.845549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.845638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.845805] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.845946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.846027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.846169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.846315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.846406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.846465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.846602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.846678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.848295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.848295] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.002158] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.002429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.002429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.003071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.003071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.003071] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 is going to be created. [ 697.031296] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.031447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.031494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.031701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.031860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.043996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: UNINITIALIZED for 2s [ 697.186904] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 697.186904] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 697.186904] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 697.187590] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 697.187590] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 697.187997] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 697.187997] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.188172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.188352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.188437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.188616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.188869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.188869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.189024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.189245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.189320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.189320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.189474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.189558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.189648] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_rules [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_rules [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 697.241477] env[65080]: INFO networking_nsxv3.common.synchronization [req-063481da-8666-4f22-ac81-2f1fb4f4d092 req-d87406fe-e571-4fbc-b2d9-da712b9a6f2f tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 697.242543] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 697.242849] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_rules [ 697.243107] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 697.243268] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b802bca7-53c8-4a32-bd47-dd9247f9189b with Priority: HIGHEST for action port [ 697.243771] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_rules [ 697.243986] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 697.244053] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 697.244677] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.244785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.244994] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.245191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.245191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.245515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.245662] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.248501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.248501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.248501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b802bca7-53c8-4a32-bd47-dd9247f9189b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.248501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.248501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.248501] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b802bca7-53c8-4a32-bd47-dd9247f9189b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.250783] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.250913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.251114] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.251267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.251474] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.251560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.349039] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b95378-31e5-4020-807b-04d9b89c292b: rpc.has_security_group_logging(os_id): False [ 697.370840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.371039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.371130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.371458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.371563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.372136] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.372136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.372136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.372337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.372337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.372567] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.373162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.373162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.373162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.373162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.373398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.373467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.373570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.373697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.373758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.373849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be created. [ 697.475558] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.475558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.475558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.475558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.475918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.497175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 697.692583] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.747950] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.748149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.752640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b802bca7-53c8-4a32-bd47-dd9247f9189b with status ACTIVE [ 697.752869] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.753041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.753116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.753479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.753587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.753786] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.753894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.753957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.754188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.754306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.754521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.754619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.754721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.754825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.754901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.754998] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b802bca7-53c8-4a32-bd47-dd9247f9189b is going to be updated. [ 697.782599] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.782759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.782848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.783353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.783576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.787494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b802bca7-53c8-4a32-bd47-dd9247f9189b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.195708] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.276605] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 698.277053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.277053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.278103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.278103] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.278103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.278103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.278103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.278103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.278103] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.281498] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 698.281498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.282075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.282420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.282711] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.282881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.282965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.283316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.283449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.283557] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.700664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.700819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.700887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.701197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.701334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.701449] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be created. [ 698.741529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.741529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.741529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.741529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.741529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.752598] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: UNINITIALIZED for 2s [ 698.780397] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.785764] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.801029] env[65080]: INFO networking_nsxv3.common.synchronization [req-8b36b838-0b2d-4ec5-b349-7760e904537f req-81c04ede-7358-4d94-9b5d-3dcdf14346fe tempest-SecurityGroupRulesTestJSON-59813724 tempest-SecurityGroupRulesTestJSON-59813724-project-member] Enqueued Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 698.801029] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec25a1a8-e425-4143-b8c8-a3f74933498c with Priority: HIGHEST for action security_group_rules [ 698.801029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec25a1a8-e425-4143-b8c8-a3f74933498c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.801029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.801029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.801029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.801029] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec25a1a8-e425-4143-b8c8-a3f74933498c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.056450] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: SUCCESS [ 699.056679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.056857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.057089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.057282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.057395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.057464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.057619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.057685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.058417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.058417] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.283943] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.288476] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.338686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.339357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.339357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.339466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.339507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.339611] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec25a1a8-e425-4143-b8c8-a3f74933498c already deleted. [ 699.339699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec25a1a8-e425-4143-b8c8-a3f74933498c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.512099] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 699.512099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.565022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.565022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.565022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.565723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.565723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.565723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565723] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.786678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.786849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.786923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.787454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.787454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.787454] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be updated. [ 699.792896] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.792896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.792896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.792896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.792896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.792896] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 699.850578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.850752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.851800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.852955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.852955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.856311] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.856524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.856524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.856724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.856855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.888246] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 699.889428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 700.066550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdc4df4f-1494-4be5-9f4c-02d2b0808e83: rpc.has_security_group_logging(os_id): False [ 700.096960] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.097522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.097522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.097522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.097842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.097842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.097949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.098056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.098297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.098424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.098597] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.098690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.098766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.098902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.098979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.100901] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.101058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.101168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.101335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.101421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.101553] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 is going to be created. [ 700.180358] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.180358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.180358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.180673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.181990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.194287] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: IN_PROGRESS for 2s [ 700.248996] env[65080]: INFO networking_nsxv3.common.synchronization [req-af09d2a5-0757-474a-85f7-79895031a027 req-5be6fb91-71cb-438d-a83c-04297beee5f0 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 700.249895] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 700.250233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.250491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.250491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.250728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.250783] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.250862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.250921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.251496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.251667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.251667] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.291922] env[65080]: INFO networking_nsxv3.common.synchronization [req-af09d2a5-0757-474a-85f7-79895031a027 req-5be6fb91-71cb-438d-a83c-04297beee5f0 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 700.293360] env[65080]: INFO networking_nsxv3.common.synchronization [req-af09d2a5-0757-474a-85f7-79895031a027 req-5be6fb91-71cb-438d-a83c-04297beee5f0 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 700.293559] env[65080]: INFO networking_nsxv3.common.synchronization [req-af09d2a5-0757-474a-85f7-79895031a027 req-5be6fb91-71cb-438d-a83c-04297beee5f0 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 700.294353] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 700.294493] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 700.295417] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 700.296165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.296364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.296422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.296739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.296822] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.300939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.303196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.303695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-113fee7a-0fc9-4456-9438-2239d32409c7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.303860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.303860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.303979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.304575] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113fee7a-0fc9-4456-9438-2239d32409c7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.673573] env[65080]: INFO networking_nsxv3.common.synchronization [req-3303d7f7-0e6f-4a47-8b69-7aac9291eaf8 req-a4ae3c18-77cb-440f-9392-133b8948398b tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 700.674335] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 700.676059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.676273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.676273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.677597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.677597] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.677597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.681056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.681056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.681056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.681056] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.758330] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.768321] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: SUCCESS [ 700.768621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.769661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.769962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.770242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.770409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.770528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.770713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.770830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.770968] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.806201] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.806358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.806648] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 113fee7a-0fc9-4456-9438-2239d32409c7 with status ACTIVE [ 700.806825] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.806934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.807230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.807512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.807784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.807873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.808067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.808874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.808874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.808874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.808874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.808874] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 113fee7a-0fc9-4456-9438-2239d32409c7 is going to be updated. [ 700.854406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.854564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.855093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.855464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.855815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.855911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.183064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.183064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.183064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.183491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.183491] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 701.220985] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.221196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.221318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.221503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.221645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.246108] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 701.260660] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.275730] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.764024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.764304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.764304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.764849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.764849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.764849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 701.779182] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.801761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.801761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.801761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.801761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.801761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.817289] env[65080]: INFO networking_nsxv3.common.synchronization [req-80ba1258-f483-4446-8bc6-3375531e5f83 req-54e4b5a9-2b11-47c7-a019-bfcefc42cfb4 tempest-ServerAddressesTestJSON-1962121823 tempest-ServerAddressesTestJSON-1962121823-project-member] Enqueued Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 701.818811] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 701.819936] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGHEST for action security_group_members [ 701.819936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.819936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.819936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.820216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.820261] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.820361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.820422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.820580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.820685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.820789] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.902638] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 701.902638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903055] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 701.903671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.904038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.904159] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.904390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.904390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.904635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.904761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.905277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.905277] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.906197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.906197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.906343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.906427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.906490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.906629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.906921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.906921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.906921] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.907770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.907946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.908501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.908501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.908501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.908501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.908501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.908773] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.909552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.909677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.910477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.910477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.910477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.910477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.914479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.914479] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.212852] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: SUCCESS [ 702.213208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.284933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.285128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.285190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.285451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.285505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.285593] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be updated. [ 702.298283] env[65080]: INFO networking_nsxv3.common.synchronization [req-5d59de21-c92e-4206-aaed-d4f6dc5685bf req-5cf7b851-af3b-46b6-b96c-0bdaf462832f tempest-InstanceActionsNegativeTestJSON-151070901 tempest-InstanceActionsNegativeTestJSON-151070901-project-member] Enqueued Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 702.298283] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409c4860-3410-423b-b6d1-e6ef10d36332 with Priority: HIGHEST for action security_group_members [ 702.301521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-409c4860-3410-423b-b6d1-e6ef10d36332 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.301521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.301521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.301521] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('409c4860-3410-423b-b6d1-e6ef10d36332',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.324057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.324232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.324858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.324858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.324858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.325059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.325287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.325287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.325803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.325803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.325803] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d is going to be updated. [ 702.349924] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.350201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.350293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.350543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.350760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: IN_PROGRESS for 2s [ 702.404804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.404804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.405041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.405197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.405362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.410044] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.419199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.419411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.420883] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.422100] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.427793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: IN_PROGRESS for 2s [ 702.805499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.805923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.805923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.806049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.806165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.806413] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.806532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.806762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.806907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.806991] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 409c4860-3410-423b-b6d1-e6ef10d36332 is going to be updated. [ 702.844553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.844553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.844553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.844785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.844895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.857062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: IN_PROGRESS for 2s [ 702.914683] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957: rpc.has_security_group_logging(os_id): False [ 702.927883] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.931418] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.936811] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.936811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.936811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.937086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.937194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.937344] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.937449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.937512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.937675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.937745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.937843] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be created. [ 703.007498] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.007498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.007498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.007690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.007866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.022310] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 703.269172] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 703.269477] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 703.269608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.432418] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.433011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.433011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.433011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.433183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.433218] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be updated. [ 703.434717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.434839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.434905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.435112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.435199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.435292] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 703.470266] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.470266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.470266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.470266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.471393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.474088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.474426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.474621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.474926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.475236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489551] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 703.490148] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 703.830711] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 703.830988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.831208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.831607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.831906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.831906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.832028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.832129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.832208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.832315] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.336367] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.386262] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: SUCCESS [ 704.386433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.386881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.387108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.387301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.387414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.387477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.387742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.387808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.387870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.387962] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.439887] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d in Status: SUCCESS [ 704.439887] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d deletion is rescheduled due to dependency. [ 704.439887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.841512] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.870038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 409c4860-3410-423b-b6d1-e6ef10d36332 in Status: SUCCESS [ 704.870038] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 409c4860-3410-423b-b6d1-e6ef10d36332 deletion is rescheduled due to dependency. [ 704.870237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-409c4860-3410-423b-b6d1-e6ef10d36332" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.890122] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.048999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 705.048999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.049214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.049619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.049619] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.165456] env[65080]: INFO networking_nsxv3.common.synchronization [req-8568fdff-be0a-4008-b5fb-a0532f6c654a req-b5367095-9a13-4f8e-97c7-e7ca731b0b6e tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 705.167035] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 705.167359] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.167466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.186704] env[65080]: INFO networking_nsxv3.common.synchronization [req-8568fdff-be0a-4008-b5fb-a0532f6c654a req-b5367095-9a13-4f8e-97c7-e7ca731b0b6e tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 705.186704] env[65080]: INFO networking_nsxv3.common.synchronization [req-8568fdff-be0a-4008-b5fb-a0532f6c654a req-b5367095-9a13-4f8e-97c7-e7ca731b0b6e tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 705.186864] env[65080]: INFO networking_nsxv3.common.synchronization [req-8568fdff-be0a-4008-b5fb-a0532f6c654a req-b5367095-9a13-4f8e-97c7-e7ca731b0b6e tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 705.188386] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_rules [ 705.188386] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 705.188386] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 113fee7a-0fc9-4456-9438-2239d32409c7 with Priority: HIGHEST for action port [ 705.188386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.188386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.188386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.188386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.188386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-113fee7a-0fc9-4456-9438-2239d32409c7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.188691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.188691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.188691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.188769] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('113fee7a-0fc9-4456-9438-2239d32409c7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.343761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.343989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.344118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.344422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.344513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.344586] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 705.390621] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.390779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.390870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.391153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.391310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.399085] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a859d56-1200-4947-a281-afd910811864: rpc.has_security_group_logging(os_id): False [ 705.406222] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 705.421093] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.421321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.421372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.421675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.421824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.422314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.422314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.422469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.422606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.422688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.422783] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be created. [ 705.518244] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 705.518244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.518244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.518244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.518771] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.518771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.518771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.518904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.519144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.519144] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.520966] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 705.521198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.521362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.521542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.521718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.521912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.521912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.522127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.522127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.522235] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.548579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.548859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.548859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.549039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.549233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.553062] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.553062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.563056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: IN_PROGRESS for 2s [ 705.697259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 113fee7a-0fc9-4456-9438-2239d32409c7 with status ACTIVE [ 705.697259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.697259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.697259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.697259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.697885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.697885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.697885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.697885] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 113fee7a-0fc9-4456-9438-2239d32409c7 is going to be updated. [ 705.725549] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.725716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.725826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.725959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.726115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.726279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-113fee7a-0fc9-4456-9438-2239d32409c7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.028303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.030149] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.493671] env[65080]: INFO networking_nsxv3.common.synchronization [req-c2783868-7929-48dd-8824-f5b3563c8837 req-df6528f1-3808-4087-9b2b-c7b65c68be1f tempest-ServerMetadataNegativeTestJSON-1973104987 tempest-ServerMetadataNegativeTestJSON-1973104987-project-member] Enqueued Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 706.494525] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGHEST for action security_group_members [ 706.494794] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.494794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.495102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.495280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.495462] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.495585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.495651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.495823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.495910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.496018] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.533574] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.534543] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.000364] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.000725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.000906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.001936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.004023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.004023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.004023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.004023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.004023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.004023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.004023] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 is going to be updated. [ 707.035580] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.036614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.036614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.036614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.036614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.037862] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.038009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.039146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.039413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.039526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.039653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 707.041277] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.041277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.042701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.042701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.042701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.042701] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be updated. [ 707.059115] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: IN_PROGRESS for 2s [ 707.086302] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.086607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.086776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.087103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.087289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.089106] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.089225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.089297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.089473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.089596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.104509] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 707.104993] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 707.421022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.421022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.421022] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.421022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.421799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.422163] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.422725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.422932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.425255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.425255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.425255] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.578047] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: SUCCESS [ 707.578198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.925871] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.927017] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.428820] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6910c0-f6a2-426f-8968-cad99131eb9b: rpc.has_security_group_logging(os_id): False [ 708.430430] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.453952] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.454096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.454138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.454365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.454439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.454750] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.454840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.454840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.454987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.455077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.455162] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 708.540188] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.540339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.540339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.540547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.541578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.562340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 708.936237] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.936237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.936237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.936237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.936237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.936237] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 708.971183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.971387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.971387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.971725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.971858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.984520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 709.072224] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 in Status: SUCCESS [ 709.073179] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 deletion is rescheduled due to dependency. [ 709.073179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.119487] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 709.120050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.120050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.120167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.120355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.120512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.120558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.120706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.120933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.120933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.121044] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.121341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.121341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.121536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.121665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.121765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.121865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.121977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.122297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.122509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.122554] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.124630] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 709.124630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.124630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.124782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.124923] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.124976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.125604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.125604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.125604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.125604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.125604] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.628653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 709.628949] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.650812] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.650954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.654664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.654664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.654664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.654664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.655369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.655369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.655369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.655369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.655369] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 709.769025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.769025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.769025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.769025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.769025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.801930] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 710.132366] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957: rpc.has_security_group_logging(os_id): False [ 710.153845] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.153994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.154072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.154287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.154380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.154680] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.154786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.154846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.154993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.155092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.155177] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be updated. [ 710.222074] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.222344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.222416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.223525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.223525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.240880] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 710.574538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 710.574855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.576081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.576695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.576916] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.997141] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 710.997479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.997520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.999044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.999211] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.999368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.999486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.999668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.999772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.999894] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.081812] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.081812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.496049] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 711.496049] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 711.502610] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.816541] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 711.816541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.816541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.816541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.816541] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.005613] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.264296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 712.264296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.318194] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.318427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.318508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.318772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.319011] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.319112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.319153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.319450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.319563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.319899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.320083] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.508282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.508478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.508547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.508824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.508951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.509089] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 712.585902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.586327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.586501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.586804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.587067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.606450] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 712.823043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.823228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.823288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.823668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.824071] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.824071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.824241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.824313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.824402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.824505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.824672] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.824766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.824815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.825048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.825130] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.825395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.825395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.825606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.825606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.825606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.825682] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.328353] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 713.369407] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.369407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.369407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.371919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.371919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.371919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.371919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.372400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.372400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.372554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.372554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.372821] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 713.443480] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.443650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.443692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.443897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.444056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.461751] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 713.483966] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d06501c1-35a6-42ed-a90f-e002d38c8b59 None None] Enqueued Resource ID: 5dbce586-7740-46da-8fa6-7440804a3589 with Priority: HIGHEST for action port [ 713.484618] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbce586-7740-46da-8fa6-7440804a3589 with Priority: HIGHEST for action port [ 713.484958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dbce586-7740-46da-8fa6-7440804a3589 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.485573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dbce586-7740-46da-8fa6-7440804a3589" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.485835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dbce586-7740-46da-8fa6-7440804a3589" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.485960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dbce586-7740-46da-8fa6-7440804a3589" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.486015] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dbce586-7740-46da-8fa6-7440804a3589',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.529679] env[65080]: INFO networking_nsxv3.common.synchronization [req-2da9f96c-7324-4a0e-8cd7-e3e799301b54 req-55582045-4f3c-4723-8ec8-34f81766c503 tempest-AttachInterfacesUnderV243Test-1359995924 tempest-AttachInterfacesUnderV243Test-1359995924-project-member] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 713.530496] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGHEST for action security_group_members [ 713.531622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.531742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.987830] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5dbce586-7740-46da-8fa6-7440804a3589 [ 713.988160] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.988353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.988448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.989127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.989127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.989127] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5dbce586-7740-46da-8fa6-7440804a3589 already deleted. [ 713.989127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dbce586-7740-46da-8fa6-7440804a3589" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.619399] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 714.619807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.620101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.629609] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.629609] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.629609] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.629609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.629609] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.126909] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.130983] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.130983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.130983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.130983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.130983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.131459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.131459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.131459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.131763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.131763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.131763] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 715.174362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.174444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.175680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.175680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.175680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.192282] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 715.479851] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 715.480104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.514418] env[65080]: INFO networking_nsxv3.common.synchronization [None req-58b01bb2-24f5-4383-9587-d5ad86f50d1b tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 715.515739] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 715.515739] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.515739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.516062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.516093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.516175] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.629642] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc6910c0-f6a2-426f-8968-cad99131eb9b: rpc.has_security_group_logging(os_id): False [ 715.634288] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3ca0cb62-f9ee-44fd-964a-c6e7cd65237a tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 715.638380] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 715.638932] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.639270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.658461] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658461] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.658461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658461] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be updated. [ 715.748728] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.748728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.748728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.750566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.751962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.773664] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: IN_PROGRESS for 2s [ 716.044039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.046074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.046151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.046477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.046609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.046740] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf already deleted. [ 716.046838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.047039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.047213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.047302] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.242135] env[65080]: INFO networking_nsxv3.common.synchronization [None req-813cf2e2-217e-4252-ae11-68bf60fc6262 None None] Enqueued Resource ID: 71ca89c9-b5c1-4824-8481-e88c045fd4a0 with Priority: HIGHEST for action port [ 716.242724] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ca89c9-b5c1-4824-8481-e88c045fd4a0 with Priority: HIGHEST for action port [ 716.243033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ca89c9-b5c1-4824-8481-e88c045fd4a0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.243156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ca89c9-b5c1-4824-8481-e88c045fd4a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.243247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ca89c9-b5c1-4824-8481-e88c045fd4a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.243625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ca89c9-b5c1-4824-8481-e88c045fd4a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.243711] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ca89c9-b5c1-4824-8481-e88c045fd4a0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.575131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.575131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.575131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.575335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.575381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.575496] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf already deleted. [ 716.575554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.746756] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ca89c9-b5c1-4824-8481-e88c045fd4a0 [ 716.747133] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.747133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.751197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.751197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.751197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.751197] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ca89c9-b5c1-4824-8481-e88c045fd4a0 already deleted. [ 716.751197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ca89c9-b5c1-4824-8481-e88c045fd4a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.208122] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 717.209523] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b deletion is rescheduled due to dependency. [ 717.209523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.794173] env[65080]: INFO networking_nsxv3.common.synchronization [req-7e92de3f-2854-40d9-8dc4-6aaede5dffb7 req-766fdda9-e5c6-483e-9745-29aa942792c1 tempest-VolumesAdminNegativeTest-1276364567 tempest-VolumesAdminNegativeTest-1276364567-project-member] Enqueued Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 717.796929] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGHEST for action security_group_members [ 717.796929] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc6910c0-f6a2-426f-8968-cad99131eb9b in Status: SUCCESS [ 717.796929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.796929] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.796929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.796929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.796929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.796929] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.801354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.801354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.801354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.801354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.801757] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.132650] env[65080]: INFO networking_nsxv3.common.synchronization [req-a89b5da6-61d2-4c56-9728-81bb29d3d124 req-edb45797-cafa-400b-9755-5c6a35526093 tempest-InstanceActionsTestJSON-1866014733 tempest-InstanceActionsTestJSON-1866014733-project-member] Enqueued Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 718.133151] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 718.133573] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.133700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.133818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.134313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.134313] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.134313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.134313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.136428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.136428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.136428] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.305842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.305842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.305842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.305842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.305842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.306090] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.306168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.306304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.306865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.306865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.306865] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 is going to be updated. [ 718.351219] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.351399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.351476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.352044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.352363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.367045] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: IN_PROGRESS for 2s [ 718.640433] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.640590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.640682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.641939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.641939] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f5d56a6-c880-45fc-9906-c91296be3017 already deleted. [ 718.641939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.704956] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.705859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-76" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.705859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-76" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.705859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-76" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.705859] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.706162] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.706162] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.706322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.706494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.706658] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.706763] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.706864] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.706963] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.711043] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.711043] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.711043] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.738793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.739471] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.739471] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.739600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-76" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.739925] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-07eedad1-29ad-4d30-ad09-b1091151a8f2 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.740191] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.740468] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.740596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.740733] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07eedad1-29ad-4d30-ad09-b1091151a8f2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.248095] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.249050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.249050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.249050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.249050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.249050] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 07eedad1-29ad-4d30-ad09-b1091151a8f2 not found, creating... [ 719.249200] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.249575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.249575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.249673] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.250316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.250316] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.250316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.250316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.250600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.250729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.250769] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 07eedad1-29ad-4d30-ad09-b1091151a8f2 is going to be created. [ 719.279096] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.279367] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.280493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.280493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.280493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.280493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.949753] env[65080]: INFO networking_nsxv3.common.synchronization [req-689037d1-54a1-4df8-8413-6341d6b75913 req-9e029e5c-8181-4189-b560-140c5b6708fc tempest-VolumesAssistedSnapshotsTest-889949791 tempest-VolumesAssistedSnapshotsTest-889949791-project-member] Enqueued Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 719.950260] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f with Priority: HIGHEST for action security_group_members [ 719.950984] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e59560e-07cb-4010-9db4-01e08b7a2a6f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.951134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.951218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.951493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.951681] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.951791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.951851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.952046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.952134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.952271] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e59560e-07cb-4010-9db4-01e08b7a2a6f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.074903] env[65080]: INFO networking_nsxv3.common.synchronization [req-a89b5da6-61d2-4c56-9728-81bb29d3d124 req-171a1c83-0924-43c7-94cf-35727a40a80d service nova] Enqueued Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_rules [ 720.075093] env[65080]: INFO networking_nsxv3.common.synchronization [req-a89b5da6-61d2-4c56-9728-81bb29d3d124 req-171a1c83-0924-43c7-94cf-35727a40a80d service nova] Enqueued Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 720.075293] env[65080]: INFO networking_nsxv3.common.synchronization [req-a89b5da6-61d2-4c56-9728-81bb29d3d124 req-171a1c83-0924-43c7-94cf-35727a40a80d service nova] Enqueued Resource ID: 07eedad1-29ad-4d30-ad09-b1091151a8f2 with Priority: HIGHEST for action port [ 720.075844] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_rules [ 720.076020] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 720.076136] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07eedad1-29ad-4d30-ad09-b1091151a8f2 with Priority: HIGHEST for action port [ 720.076424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.076547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.076651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.076884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.076968] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.078499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.078499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.078499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.078499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.079554] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.079554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.079554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.079554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.079554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.079554] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.080109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-07eedad1-29ad-4d30-ad09-b1091151a8f2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.080109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.080109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.080286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.080379] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07eedad1-29ad-4d30-ad09-b1091151a8f2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.378996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 in Status: SUCCESS [ 720.378996] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 deletion is rescheduled due to dependency. [ 720.378996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.455913] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.456109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.456186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.456417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.456578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.456843] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.456950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.457072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.457268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.457401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.457515] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f is going to be updated. [ 720.489236] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.489236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.489236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.489425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.489536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.499419] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: IN_PROGRESS for 2s [ 720.582036] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.582172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.582369] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.585867] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07eedad1-29ad-4d30-ad09-b1091151a8f2 with status ACTIVE [ 720.585867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.585867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.585867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.585867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.589740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.589740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.589740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.589740] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07eedad1-29ad-4d30-ad09-b1091151a8f2 is going to be updated. [ 720.613860] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.613860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.613860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.613860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.613860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.613860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07eedad1-29ad-4d30-ad09-b1091151a8f2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.933624] env[65080]: INFO networking_nsxv3.common.synchronization [req-bc83863c-31cb-4a28-aa81-c0abcfabf08d req-99bb8f30-ad45-4ec4-ab02-dd16e40598f7 tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 720.934251] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 720.934592] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.934721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.934788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.934992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.935156] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.935255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.935314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.935460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.935547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.935641] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.089312] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.371020] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.371020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.371020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.371020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.371020] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.371020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.371020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.371752] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.372101] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.375020] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.375020] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.375020] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.375020] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.375020] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.375020] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.375020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.397526] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.397874] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.397975] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.398337] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-797" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.398785] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.399268] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.399614] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.399765] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92cbf2ca-0c0c-4b3e-b01e-a6365b06296a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.437353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.437353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.437552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.439655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.439655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.439655] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be updated. [ 721.466792] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.466971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.467166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.467234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.467382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.478660] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 721.594033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.594033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.594033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.594033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.594033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.594378] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f5d56a6-c880-45fc-9906-c91296be3017 is going to be created. [ 721.624958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.625128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.625197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.625425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.625581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.637857] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: UNINITIALIZED for 2s [ 721.905617] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.905617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.905617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.905617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.905617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.905855] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a not found, creating... [ 721.906336] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.906336] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.906494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.907387] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.907387] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.907387] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.907387] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.907387] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.908537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.909037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a is going to be created. [ 721.930771] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.931306] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.931472] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.931770] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.931994] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.932257] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.509604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f in Status: SUCCESS [ 722.510017] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e59560e-07cb-4010-9db4-01e08b7a2a6f deletion is rescheduled due to dependency. [ 722.510584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e59560e-07cb-4010-9db4-01e08b7a2a6f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.691648] env[65080]: INFO networking_nsxv3.common.synchronization [req-bc83863c-31cb-4a28-aa81-c0abcfabf08d req-458da4af-19de-45a8-b742-d7c2f81ef562 service nova] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 722.691648] env[65080]: INFO networking_nsxv3.common.synchronization [req-bc83863c-31cb-4a28-aa81-c0abcfabf08d req-458da4af-19de-45a8-b742-d7c2f81ef562 service nova] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 722.691648] env[65080]: INFO networking_nsxv3.common.synchronization [req-bc83863c-31cb-4a28-aa81-c0abcfabf08d req-458da4af-19de-45a8-b742-d7c2f81ef562 service nova] Enqueued Resource ID: 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a with Priority: HIGHEST for action port [ 722.691648] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_rules [ 722.692031] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 722.692290] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a with Priority: HIGHEST for action port [ 722.692766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.693042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.693350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.693666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.694534] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.697926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.697926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.697926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.697926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.697926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.697926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.697926] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92cbf2ca-0c0c-4b3e-b01e-a6365b06296a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.200989] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.201193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.201330] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a with status ACTIVE [ 723.201541] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.201666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.201735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.201963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.202091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.202292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.202447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.202447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.202593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.202678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.202888] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.202981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.203061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.203204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.203277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.203372] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92cbf2ca-0c0c-4b3e-b01e-a6365b06296a is going to be updated. [ 723.237190] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.237190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.237190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.237190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.237190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.237190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92cbf2ca-0c0c-4b3e-b01e-a6365b06296a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.491300] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 723.491719] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 deletion is rescheduled due to dependency. [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.493961] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.493961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.493961] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.649956] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: SUCCESS [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.651253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.651253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.651544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.651544] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.706321] env[65080]: INFO networking_nsxv3.common.synchronization [req-34e9443e-3164-40d6-b430-35867d1ee69d req-dfa1914f-5e88-4613-a3a1-a5f339c5b774 tempest-ServersNegativeTestMultiTenantJSON-879408547 tempest-ServersNegativeTestMultiTenantJSON-879408547-project-member] Enqueued Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 723.707137] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 723.709077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.709238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.709308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.709583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.709757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.709860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.709922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.710084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.710172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.710268] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.996355] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.153983] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.154170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.154213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.154618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.154714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.154776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.154808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.154974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.155079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.155172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.155321] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.155413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.155476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.155735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.155804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.155958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.156033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.156200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.156281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.156416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.156473] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.203874] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.204078] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-357" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.204192] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-357" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.204621] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-357" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.204947] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.205498] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.205644] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.205900] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.206062] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.206274] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.206741] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.206884] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.206986] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.207108] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.207211] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.207338] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.213787] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.213947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.214009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.214218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.214310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.214510] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.214659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.214659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.214794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.214871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.214955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 already deleted. [ 724.215052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.231022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.231194] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.231314] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.231513] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-357" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.231828] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-2674ba77-bcf8-47d4-9082-55c3c98dc412 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.232033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.232266] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.232622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.232768] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2674ba77-bcf8-47d4-9082-55c3c98dc412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.532911] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.711480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f5d56a6-c880-45fc-9906-c91296be3017: rpc.has_security_group_logging(os_id): False [ 724.731027] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.731274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.731274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.731699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.731884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.733086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.733086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.733086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.733086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.733086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.733323] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.733323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.733393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.733585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.733664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.733954] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.734065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.734137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.734290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.734366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.734453] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f5d56a6-c880-45fc-9906-c91296be3017 is going to be created. [ 724.739389] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.741490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 2674ba77-bcf8-47d4-9082-55c3c98dc412 not found, creating... [ 724.741490] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.741490] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.741879] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.741930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.742012] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.742309] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.742459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.742618] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 2674ba77-bcf8-47d4-9082-55c3c98dc412 is going to be created. [ 724.778978] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.779226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.779480] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.779811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.780180] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.780452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.851531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.851739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.851739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.852046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.852165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.871462] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: IN_PROGRESS for 2s [ 725.210416] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.210528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.211115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.211115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.211115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.211115] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be updated. [ 725.251430] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.251768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.251842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.252081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.252232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.264557] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 725.493447] env[65080]: INFO networking_nsxv3.common.synchronization [req-34e9443e-3164-40d6-b430-35867d1ee69d req-c6c3fd75-b3d5-4c44-99fb-ed3a68d16573 service nova] Enqueued Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_rules [ 725.493732] env[65080]: INFO networking_nsxv3.common.synchronization [req-34e9443e-3164-40d6-b430-35867d1ee69d req-c6c3fd75-b3d5-4c44-99fb-ed3a68d16573 service nova] Enqueued Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 725.493896] env[65080]: INFO networking_nsxv3.common.synchronization [req-34e9443e-3164-40d6-b430-35867d1ee69d req-c6c3fd75-b3d5-4c44-99fb-ed3a68d16573 service nova] Enqueued Resource ID: 2674ba77-bcf8-47d4-9082-55c3c98dc412 with Priority: HIGHEST for action port [ 725.494893] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_rules [ 725.495238] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 725.495453] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2674ba77-bcf8-47d4-9082-55c3c98dc412 with Priority: HIGHEST for action port [ 725.496033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.496214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.496376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.496794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.496957] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.498506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.498671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.498746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.498987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.499406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.499565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.499704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.499968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.500128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.500548] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.501415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2674ba77-bcf8-47d4-9082-55c3c98dc412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.501602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.501815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.502078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.502212] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2674ba77-bcf8-47d4-9082-55c3c98dc412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.582057] env[65080]: INFO networking_nsxv3.common.synchronization [None req-411aa239-a658-490e-b786-458467c36de0 None None] Enqueued Resource ID: 7e213b94-eae6-432d-8440-f76a8dac7b5e with Priority: HIGHEST for action port [ 725.582057] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e213b94-eae6-432d-8440-f76a8dac7b5e with Priority: HIGHEST for action port [ 725.582057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e213b94-eae6-432d-8440-f76a8dac7b5e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.582057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e213b94-eae6-432d-8440-f76a8dac7b5e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.582507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e213b94-eae6-432d-8440-f76a8dac7b5e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.583330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e213b94-eae6-432d-8440-f76a8dac7b5e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.583724] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e213b94-eae6-432d-8440-f76a8dac7b5e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.005283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.005590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.005590] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.007248] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2674ba77-bcf8-47d4-9082-55c3c98dc412 with status ACTIVE [ 726.007248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.007248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.007248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.007248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.007248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.007477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.007477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.007542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.007701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.007748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.012175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.012175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.012175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.012175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.012175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.012443] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2674ba77-bcf8-47d4-9082-55c3c98dc412 is going to be updated. [ 726.047590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.048586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.049200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.050021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.050021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.050495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2674ba77-bcf8-47d4-9082-55c3c98dc412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.089135] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e213b94-eae6-432d-8440-f76a8dac7b5e [ 726.089135] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.089135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.089135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.089135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.089135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.089135] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e213b94-eae6-432d-8440-f76a8dac7b5e already deleted. [ 726.089135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e213b94-eae6-432d-8440-f76a8dac7b5e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.515112] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.765071] env[65080]: INFO networking_nsxv3.common.synchronization [req-5edbe123-ee48-4c90-9416-d43b7fefe603 req-43bf9b93-169f-4185-b294-f963145c2898 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 726.765624] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 726.765955] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.766293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.766388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.766616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.766812] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.766943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.767038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.767226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.768576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.768734] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.885521] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: SUCCESS [ 726.886399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.019766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.020110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.020110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.020323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.020453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.020556] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 is going to be created. [ 727.047729] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.047729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.047729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.047729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.047948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.066662] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: UNINITIALIZED for 2s [ 727.272115] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.272738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.272738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.272738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.272883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.273050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.273158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.273282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.273368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.273446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.273599] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 727.277293] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 727.277371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.278376] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.278613] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.278780] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.279071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.279379] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.279609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.279746] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.280021] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.280213] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.280520] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.280699] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.280874] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.281078] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.281279] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.281526] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.281939] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.283068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.283270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.283528] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.283709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.283838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.284109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.284276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.284350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.284468] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.323579] env[65080]: INFO networking_nsxv3.common.synchronization [None req-576f141c-ec10-47a6-8700-9a067960387c None None] Enqueued Resource ID: 7ad1ef1b-a13b-4809-b69e-51d900f2f4b6 with Priority: HIGHEST for action port [ 727.324178] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad1ef1b-a13b-4809-b69e-51d900f2f4b6 with Priority: HIGHEST for action port [ 727.324522] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ad1ef1b-a13b-4809-b69e-51d900f2f4b6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.324657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ad1ef1b-a13b-4809-b69e-51d900f2f4b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.324719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ad1ef1b-a13b-4809-b69e-51d900f2f4b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.325020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ad1ef1b-a13b-4809-b69e-51d900f2f4b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.326236] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad1ef1b-a13b-4809-b69e-51d900f2f4b6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.328084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.328232] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.328458] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.328674] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.329059] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-5d675510-b272-49ef-9821-b7223e1c64c3 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.329522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.329773] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.330769] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.330769] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d675510-b272-49ef-9821-b7223e1c64c3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.340440] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.341024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.341024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.341548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.341726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.367265] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 727.789054] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.832875] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ad1ef1b-a13b-4809-b69e-51d900f2f4b6 [ 727.833192] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.833192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.833297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.833470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.833582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.833677] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ad1ef1b-a13b-4809-b69e-51d900f2f4b6 already deleted. [ 727.833772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ad1ef1b-a13b-4809-b69e-51d900f2f4b6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.834232] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.834378] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.834467] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.834725] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.834858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.834999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 5d675510-b272-49ef-9821-b7223e1c64c3 not found, creating... [ 727.835261] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.835418] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.835526] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.835724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.835930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.836123] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.836270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.836379] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.836574] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.836703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.836862] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 5d675510-b272-49ef-9821-b7223e1c64c3 is going to be created. [ 727.859215] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.859429] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.859544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.859868] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.860126] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.860371] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.292144] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0: rpc.has_security_group_logging(os_id): False [ 728.332817] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.333094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.333181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.333545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.333661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.334040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.334188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.334283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.334616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.334752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.334824] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be updated. [ 728.426684] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.426684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.426684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.426978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.427083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.444621] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 728.591304] env[65080]: INFO networking_nsxv3.common.synchronization [req-5edbe123-ee48-4c90-9416-d43b7fefe603 req-7b3b5580-01f3-4972-82c9-9065b602b88e service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 728.591535] env[65080]: INFO networking_nsxv3.common.synchronization [req-5edbe123-ee48-4c90-9416-d43b7fefe603 req-7b3b5580-01f3-4972-82c9-9065b602b88e service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 728.591632] env[65080]: INFO networking_nsxv3.common.synchronization [req-5edbe123-ee48-4c90-9416-d43b7fefe603 req-7b3b5580-01f3-4972-82c9-9065b602b88e service nova] Enqueued Resource ID: 5d675510-b272-49ef-9821-b7223e1c64c3 with Priority: HIGHEST for action port [ 728.592130] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 728.592264] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 728.592364] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d675510-b272-49ef-9821-b7223e1c64c3 with Priority: HIGHEST for action port [ 728.592633] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.592820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.592889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.593101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.593237] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.594443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.594540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.594878] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d675510-b272-49ef-9821-b7223e1c64c3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.594878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.595019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.595103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.596166] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d675510-b272-49ef-9821-b7223e1c64c3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.860955] env[65080]: INFO networking_nsxv3.common.synchronization [None req-083b21cf-acba-4940-810e-743852129000 None None] Enqueued Resource ID: 71a3d22b-1c60-4468-925a-97da38c84ec7 with Priority: HIGHEST for action port [ 728.863996] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71a3d22b-1c60-4468-925a-97da38c84ec7 with Priority: HIGHEST for action port [ 728.863996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-71a3d22b-1c60-4468-925a-97da38c84ec7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.863996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71a3d22b-1c60-4468-925a-97da38c84ec7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.863996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71a3d22b-1c60-4468-925a-97da38c84ec7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.863996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71a3d22b-1c60-4468-925a-97da38c84ec7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.863996] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a3d22b-1c60-4468-925a-97da38c84ec7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.079149] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: SUCCESS [ 729.079370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.079790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.080161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.080365] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.080620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.080686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.080848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.081102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.081208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.081303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.097429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.097429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.097429] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d675510-b272-49ef-9821-b7223e1c64c3 with status ACTIVE [ 729.097646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.097863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.097863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.099501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.099501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.099501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.099501] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d675510-b272-49ef-9821-b7223e1c64c3 is going to be updated. [ 729.128564] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.128564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.128564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.128564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.128564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.128564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d675510-b272-49ef-9821-b7223e1c64c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.366232] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71a3d22b-1c60-4468-925a-97da38c84ec7 [ 729.366650] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.366806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.366923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.367297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.367453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.367635] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71a3d22b-1c60-4468-925a-97da38c84ec7 already deleted. [ 729.367635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71a3d22b-1c60-4468-925a-97da38c84ec7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.380391] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 729.380391] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.380391] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.380391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.380391] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.584206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.584356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.584428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.584708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.584895] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.585043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.585083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.585249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.585334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.585425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.585571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.585869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.585869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.585869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.586021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.586083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.586150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.586372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.586455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.586542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.586744] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.747236] env[65080]: INFO networking_nsxv3.common.synchronization [None req-f3e3e1db-cf0f-4892-85dc-3ef0515e1752 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 729.747879] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 729.748224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.748352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.748420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.748673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.748757] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.883463] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.976922] env[65080]: INFO networking_nsxv3.common.synchronization [None req-081f51d4-0f02-41f3-80d6-b2821949bb02 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 729.979049] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 729.979329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.979503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.089380] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 724930a7-3e32-4bbf-8611-b93b2ddfe0f4: rpc.has_security_group_logging(os_id): False [ 730.109988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.109988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.109988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.109988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.109988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.109988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.110674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.110767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.111170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.111253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.111555] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.111650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.111650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.111812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.111884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.112314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.112314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.112438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.112572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.112822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.112822] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 is going to be created. [ 730.178205] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.178377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.178449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.178657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.178837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.193221] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: IN_PROGRESS for 2s [ 730.283871] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.284033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.284107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.285042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.285042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.285042] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d already deleted. [ 730.285042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.285042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.285042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.285356] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.389315] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.460107] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 730.460534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481917] env[65080]: INFO networking_nsxv3.common.synchronization [None req-fb52b4e0-3570-4367-8206-a14b953f0f56 None None] Enqueued Resource ID: e7c45414-cd28-4538-97c1-dbf6779dc700 with Priority: HIGHEST for action port [ 730.481917] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c45414-cd28-4538-97c1-dbf6779dc700 with Priority: HIGHEST for action port [ 730.481917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7c45414-cd28-4538-97c1-dbf6779dc700 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7c45414-cd28-4538-97c1-dbf6779dc700" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7c45414-cd28-4538-97c1-dbf6779dc700" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.484510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7c45414-cd28-4538-97c1-dbf6779dc700" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.484510] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c45414-cd28-4538-97c1-dbf6779dc700',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.807975] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.809222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.809222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.809222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.809222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.809222] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d already deleted. [ 730.809222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.892618] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.892864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.893461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.893461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.893461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.893788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 730.931623] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.932102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.935321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.935321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.935321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.947196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 730.987939] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7c45414-cd28-4538-97c1-dbf6779dc700 [ 730.987939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.987939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.987939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.987939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.987939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.987939] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7c45414-cd28-4538-97c1-dbf6779dc700 already deleted. [ 730.987939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7c45414-cd28-4538-97c1-dbf6779dc700" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.376214] env[65080]: INFO networking_nsxv3.common.synchronization [None req-f4945d34-3a8e-4535-b6c0-5e494132380d None None] Enqueued Resource ID: 8d1488c8-9054-4be3-8370-fa8a6ec35df4 with Priority: HIGHEST for action port [ 731.377094] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d1488c8-9054-4be3-8370-fa8a6ec35df4 with Priority: HIGHEST for action port [ 731.377426] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d1488c8-9054-4be3-8370-fa8a6ec35df4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.377561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d1488c8-9054-4be3-8370-fa8a6ec35df4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.378239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d1488c8-9054-4be3-8370-fa8a6ec35df4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.378239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d1488c8-9054-4be3-8370-fa8a6ec35df4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.378239] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d1488c8-9054-4be3-8370-fa8a6ec35df4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.882530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d1488c8-9054-4be3-8370-fa8a6ec35df4 [ 731.882922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.883142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.883257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.883561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.883648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.883839] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d1488c8-9054-4be3-8370-fa8a6ec35df4 already deleted. [ 731.883839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d1488c8-9054-4be3-8370-fa8a6ec35df4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.208676] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: SUCCESS [ 732.209123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.958255] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 732.959750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.959750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.959750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.959932] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.959932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.960035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.960207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.960572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.960572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.960572] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.464068] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.464226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.464475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.464718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.464718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.466428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.466428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.466715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.466715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.466715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.466852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.466900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.466986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.467094] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.472830] env[65080]: INFO networking_nsxv3.common.synchronization [None req-eef7de5a-7855-42c9-b81a-076fcae31a98 None None] Enqueued Resource ID: e640d4d3-ef85-45f4-bed9-619ab4ad81cb with Priority: HIGHEST for action port [ 733.473724] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e640d4d3-ef85-45f4-bed9-619ab4ad81cb with Priority: HIGHEST for action port [ 733.476880] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e640d4d3-ef85-45f4-bed9-619ab4ad81cb taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.476880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e640d4d3-ef85-45f4-bed9-619ab4ad81cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.476880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e640d4d3-ef85-45f4-bed9-619ab4ad81cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.476880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e640d4d3-ef85-45f4-bed9-619ab4ad81cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.476880] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e640d4d3-ef85-45f4-bed9-619ab4ad81cb',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.969737] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354ecbf4-79a8-4770-9da4-7284d1f205e7: rpc.has_security_group_logging(os_id): False [ 733.980433] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e640d4d3-ef85-45f4-bed9-619ab4ad81cb [ 733.981827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.981827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.981827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.981827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.981827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.981827] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e640d4d3-ef85-45f4-bed9-619ab4ad81cb already deleted. [ 733.981827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e640d4d3-ef85-45f4-bed9-619ab4ad81cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.993662] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.993823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.993894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.994799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.994937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.995177] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.995287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.995382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.995524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.995605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.995793] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.995888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.995949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.998100] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.998100] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 734.096037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.096037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.096037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.096405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.096405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.118432] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 735.551756] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3111e4c-e3af-40c0-9d03-374c7d7459a7 req-3356c0ee-e345-4bb7-8ef1-88bc6ac27631 tempest-ServersNegativeTestJSON-1863572029 tempest-ServersNegativeTestJSON-1863572029-project-member] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 735.552809] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 735.553113] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.553350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.553470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.553794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.554074] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.554257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.554396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.554650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.554832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.554967] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.057200] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.135167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 736.135364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.177658] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.177863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.177980] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.178293] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.178614] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.178988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.178988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.179123] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.179247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.179461] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.179570] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.179672] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.179772] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.179875] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.180096] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.180096] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.201190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.201946] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.201946] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.201946] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.202097] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-357bf134-ee17-4482-be50-ba8093f0fcae taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.202241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.202306] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.202634] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.203411] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357bf134-ee17-4482-be50-ba8093f0fcae',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.559175] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.706593] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.706593] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 357bf134-ee17-4482-be50-ba8093f0fcae not found, creating... [ 736.706593] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.706593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.706984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.707109] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.707270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.707385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.707608] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.707794] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.709143] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 357bf134-ee17-4482-be50-ba8093f0fcae is going to be created. [ 736.820523] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.820816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.820996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.821383] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.821711] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.822035] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.064340] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.064651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.064651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.064850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.064943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.065090] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 737.124345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.124592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.124592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.125708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.125708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.137332] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3111e4c-e3af-40c0-9d03-374c7d7459a7 req-5abdf8bd-0224-48f0-befc-0bd3aa6efed9 service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3111e4c-e3af-40c0-9d03-374c7d7459a7 req-5abdf8bd-0224-48f0-befc-0bd3aa6efed9 service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3111e4c-e3af-40c0-9d03-374c7d7459a7 req-5abdf8bd-0224-48f0-befc-0bd3aa6efed9 service nova] Enqueued Resource ID: 357bf134-ee17-4482-be50-ba8093f0fcae with Priority: HIGHEST for action port [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 737.459023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357bf134-ee17-4482-be50-ba8093f0fcae with Priority: HIGHEST for action port [ 737.459465] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.459601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.459667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.459979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.460052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.460877] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.461341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.461611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-357bf134-ee17-4482-be50-ba8093f0fcae taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.461765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.461837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.462165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.462247] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357bf134-ee17-4482-be50-ba8093f0fcae',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.965053] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.965053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.967833] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 357bf134-ee17-4482-be50-ba8093f0fcae with status ACTIVE [ 737.967833] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.967833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.967833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.967833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.967833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.968225] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.968507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.969434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.969699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.969815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.970048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.970160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.970239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.970428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.970507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.970601] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 357bf134-ee17-4482-be50-ba8093f0fcae is going to be updated. [ 738.004043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.004317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.004353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.004760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.005099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.005444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-357bf134-ee17-4482-be50-ba8093f0fcae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.640973] env[65080]: INFO networking_nsxv3.common.synchronization [req-bad91adc-8e84-4263-acd4-d0d2f28bfac5 req-bbd8d310-afe8-4c3a-b270-23238f689680 tempest-ImagesOneServerTestJSON-821953684 tempest-ImagesOneServerTestJSON-821953684-project-member] Enqueued Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 738.641678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGHEST for action security_group_members [ 738.642354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.642755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.642755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.642938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.643929] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.643929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.643929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.643929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.643929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.643929] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.665061] env[65080]: INFO networking_nsxv3.common.synchronization [None req-1a88497f-2cb5-45f6-8610-46510e20e60a None None] Enqueued Resource ID: 6f09b052-4f4f-4b50-b64f-a5bfc85a2391 with Priority: HIGHEST for action port [ 738.666248] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f09b052-4f4f-4b50-b64f-a5bfc85a2391 with Priority: HIGHEST for action port [ 738.666248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f09b052-4f4f-4b50-b64f-a5bfc85a2391 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.666518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f09b052-4f4f-4b50-b64f-a5bfc85a2391" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.666611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f09b052-4f4f-4b50-b64f-a5bfc85a2391" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.666861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f09b052-4f4f-4b50-b64f-a5bfc85a2391" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.666945] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f09b052-4f4f-4b50-b64f-a5bfc85a2391',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.146300] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.146746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.146746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.146746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.146746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.146894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.146994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.147100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.147221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.147297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.147514] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 is going to be updated. [ 739.149150] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 739.149318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.150214] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.150214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.150849] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.169035] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f09b052-4f4f-4b50-b64f-a5bfc85a2391 [ 739.169035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.169284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.169284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.169423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.169515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.169610] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f09b052-4f4f-4b50-b64f-a5bfc85a2391 already deleted. [ 739.169693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f09b052-4f4f-4b50-b64f-a5bfc85a2391" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.187923] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.187923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.187923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.187923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.188247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.199316] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: IN_PROGRESS for 2s [ 739.653548] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.158228] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.659513] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.660090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.660090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.660090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.660090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.660401] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 740.698347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.698658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.698843] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.699154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.699844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.712155] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 741.212782] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 in Status: SUCCESS [ 741.212782] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 deletion is rescheduled due to dependency. [ 741.212782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.719122] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6dd86245-fee0-47c8-b736-40a4fe226e99 None None] Enqueued Resource ID: f9df2259-2f68-4024-868c-04034a37efb1 with Priority: HIGHEST for action port [ 741.719713] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9df2259-2f68-4024-868c-04034a37efb1 with Priority: HIGHEST for action port [ 741.720090] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9df2259-2f68-4024-868c-04034a37efb1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.720294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9df2259-2f68-4024-868c-04034a37efb1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.720294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9df2259-2f68-4024-868c-04034a37efb1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.721234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9df2259-2f68-4024-868c-04034a37efb1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.721234] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9df2259-2f68-4024-868c-04034a37efb1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.225627] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9df2259-2f68-4024-868c-04034a37efb1 [ 742.226095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.227858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.227858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.227858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.227858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.227858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9df2259-2f68-4024-868c-04034a37efb1 already deleted. [ 742.227858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9df2259-2f68-4024-868c-04034a37efb1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.731806] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 742.731806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.732050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.732395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.732502] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.732630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.732743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.733220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.733363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.733825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.734022] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.838530] env[65080]: INFO networking_nsxv3.common.synchronization [req-6b63987e-4d87-4cf2-97f9-527533a8dd88 req-3562d6db-86e9-4ff1-9c2e-1168561898b0 tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 742.839301] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 742.839998] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.840157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.840264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.840546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.840969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.841106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.841176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.841360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.841423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.841525] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.237179] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.237179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.237179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.237690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.237690] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.237690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.237690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.237891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.237891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.237981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.238113] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.238196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.238252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.238412] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.238594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.238728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.238785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.238934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.239025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.239147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.239196] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.343865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.344104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.344204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.345069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.345069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.345069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.345311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.345311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.345597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.345722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.345823] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f already deleted. [ 743.345909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.412314] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.412589] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.412791] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.415569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.415922] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.416115] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.416240] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.416519] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.416666] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.416926] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.417052] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.417157] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.417260] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.417382] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 743.417483] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.417617] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.438467] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.438629] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 743.438840] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.438963] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.439384] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-51fd41d4-0389-46bf-93a4-64d0ceea0496 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.439562] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.439694] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.440206] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.440346] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51fd41d4-0389-46bf-93a4-64d0ceea0496',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.622603] env[65080]: INFO networking_nsxv3.common.synchronization [None req-59c3e579-4b9a-487a-b919-d74bc8f078b3 None None] Enqueued Resource ID: 7a5057a7-2373-4b28-bbd1-6e093021fa0c with Priority: HIGHEST for action port [ 743.622869] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5057a7-2373-4b28-bbd1-6e093021fa0c with Priority: HIGHEST for action port [ 743.623494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a5057a7-2373-4b28-bbd1-6e093021fa0c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.623719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a5057a7-2373-4b28-bbd1-6e093021fa0c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.623719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a5057a7-2373-4b28-bbd1-6e093021fa0c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.623984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a5057a7-2373-4b28-bbd1-6e093021fa0c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.624241] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a5057a7-2373-4b28-bbd1-6e093021fa0c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.744105] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b95378-31e5-4020-807b-04d9b89c292b: rpc.has_security_group_logging(os_id): False [ 743.773050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.773050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.773050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.773050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.773050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.773050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.773050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.773417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.773417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.773417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.773525] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.774535] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.774535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.774963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.775028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.775150] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 743.854101] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.854320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.855562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.855848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.856073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.869490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 743.943425] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.943704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.943872] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.944202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.944386] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.944550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 51fd41d4-0389-46bf-93a4-64d0ceea0496 not found, creating... [ 743.944852] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.945051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.945171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.945405] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.945539] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.945827] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.945997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.946134] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.946342] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.946505] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.946661] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 51fd41d4-0389-46bf-93a4-64d0ceea0496 is going to be created. [ 743.982114] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.984495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.984495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.984495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.984495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.984495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.128295] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a5057a7-2373-4b28-bbd1-6e093021fa0c [ 744.128295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.128295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.128295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.128295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.128295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.128295] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a5057a7-2373-4b28-bbd1-6e093021fa0c already deleted. [ 744.128295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a5057a7-2373-4b28-bbd1-6e093021fa0c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.295983] env[65080]: INFO networking_nsxv3.common.synchronization [req-0a74de0d-da53-4987-9059-f9dc1bbfdb30 req-ff7864b1-0122-4379-a64d-5ba74029dc58 tempest-InstanceActionsTestJSON-1866014733 tempest-InstanceActionsTestJSON-1866014733-project-member] Enqueued Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 744.296541] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5d56a6-c880-45fc-9906-c91296be3017 with Priority: HIGHEST for action security_group_members [ 744.296836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f5d56a6-c880-45fc-9906-c91296be3017 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.296960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.297174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.297402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.298084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.298206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.298276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.298449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.298540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.298640] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f5d56a6-c880-45fc-9906-c91296be3017',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.670560] env[65080]: INFO networking_nsxv3.common.synchronization [req-6b63987e-4d87-4cf2-97f9-527533a8dd88 req-34ac33c6-b0b0-41ff-ba34-d5cf83502d64 service nova] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_rules [ 744.670751] env[65080]: INFO networking_nsxv3.common.synchronization [req-6b63987e-4d87-4cf2-97f9-527533a8dd88 req-34ac33c6-b0b0-41ff-ba34-d5cf83502d64 service nova] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 744.670939] env[65080]: INFO networking_nsxv3.common.synchronization [req-6b63987e-4d87-4cf2-97f9-527533a8dd88 req-34ac33c6-b0b0-41ff-ba34-d5cf83502d64 service nova] Enqueued Resource ID: 51fd41d4-0389-46bf-93a4-64d0ceea0496 with Priority: HIGHEST for action port [ 744.671487] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_rules [ 744.671632] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 744.671754] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51fd41d4-0389-46bf-93a4-64d0ceea0496 with Priority: HIGHEST for action port [ 744.672077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.672206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.672437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.672559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.672672] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.673958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.674101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.674177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.674368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.674635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.674635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.674744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.674896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.674996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.675136] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.675907] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-51fd41d4-0389-46bf-93a4-64d0ceea0496 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.676049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.676476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.676476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.676476] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51fd41d4-0389-46bf-93a4-64d0ceea0496',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.804676] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.804676] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.804676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.804676] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f5d56a6-c880-45fc-9906-c91296be3017 is going to be updated. [ 744.847183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.847404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.847404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.847591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.847762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.863125] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: IN_PROGRESS for 2s [ 744.948456] env[65080]: INFO networking_nsxv3.common.synchronization [req-9ff5e61b-4ed9-4220-82c3-1bbcf21136c8 req-5e78cb59-a546-4965-8afd-64236e08dad7 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 744.949144] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 744.949415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.951436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.951554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.952393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.952393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.952393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.952393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.952621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.953236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.953363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.179529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.179529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.179529] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.180374] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51fd41d4-0389-46bf-93a4-64d0ceea0496 with status ACTIVE [ 745.180374] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.180374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.180374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.180644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.180644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.181187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.181187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.181187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.181187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.181187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.181496] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.181496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.181496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.181932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.181932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.181932] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51fd41d4-0389-46bf-93a4-64d0ceea0496 is going to be updated. [ 745.211569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.211777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.211824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.212015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.212372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.212630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51fd41d4-0389-46bf-93a4-64d0ceea0496" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.308521] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5fc29c8-a62a-4476-a776-6c8f96c155f7 req-e3a428f6-5f58-4b5e-a234-c47ddc023dea tempest-ServersNegativeTestMultiTenantJSON-879408547 tempest-ServersNegativeTestMultiTenantJSON-879408547-project-member] Enqueued Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 745.309116] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGHEST for action security_group_members [ 745.309435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.309559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.309635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.309830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.310281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.310412] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.310483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.310649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.310737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.310831] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.455839] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.659763] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5236db81-75a3-47b6-bece-88f4a55c0b7e None None] Enqueued Resource ID: cb46c4c3-a126-4272-b116-865772a39a73 with Priority: HIGHEST for action port [ 745.660983] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb46c4c3-a126-4272-b116-865772a39a73 with Priority: HIGHEST for action port [ 745.661466] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb46c4c3-a126-4272-b116-865772a39a73 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.663010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb46c4c3-a126-4272-b116-865772a39a73" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.663010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb46c4c3-a126-4272-b116-865772a39a73" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.663010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb46c4c3-a126-4272-b116-865772a39a73" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.663010] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb46c4c3-a126-4272-b116-865772a39a73',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.680284] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.813137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.813300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.813371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.813580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.813835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.814250] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.814250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.814250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.814396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.814478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.814563] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 is going to be updated. [ 745.852433] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.852851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.853026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.853329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.853571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.865522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: IN_PROGRESS for 2s [ 745.882418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 745.882653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.957988] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.164764] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb46c4c3-a126-4272-b116-865772a39a73 [ 746.165073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.165274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.165353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.165572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.165667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.165767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb46c4c3-a126-4272-b116-865772a39a73 already deleted. [ 746.165849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb46c4c3-a126-4272-b116-865772a39a73" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.183054] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.183438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.183438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.183540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.183788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.183788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be created. [ 746.211955] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.211955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.211955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.211955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.212142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.223273] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: UNINITIALIZED for 2s [ 746.441407] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d10aef82-b9e0-478b-b977-aa0706452efc None None] Enqueued Resource ID: 9d712ce5-5cea-4d16-b243-a8c4d3b9d55c with Priority: HIGHEST for action port [ 746.441989] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d712ce5-5cea-4d16-b243-a8c4d3b9d55c with Priority: HIGHEST for action port [ 746.443616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d712ce5-5cea-4d16-b243-a8c4d3b9d55c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.443616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d712ce5-5cea-4d16-b243-a8c4d3b9d55c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.443616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d712ce5-5cea-4d16-b243-a8c4d3b9d55c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.443616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d712ce5-5cea-4d16-b243-a8c4d3b9d55c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.443616] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d712ce5-5cea-4d16-b243-a8c4d3b9d55c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.461824] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.462036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.462140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.462405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.462497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.462631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 746.497730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.497892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.497949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.498183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.498966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.516941] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 746.877029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f5d56a6-c880-45fc-9906-c91296be3017 in Status: SUCCESS [ 746.877255] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f5d56a6-c880-45fc-9906-c91296be3017 deletion is rescheduled due to dependency. [ 746.877425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f5d56a6-c880-45fc-9906-c91296be3017" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.946643] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d712ce5-5cea-4d16-b243-a8c4d3b9d55c [ 746.946842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.946953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.947012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.948312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.948312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.948312] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d712ce5-5cea-4d16-b243-a8c4d3b9d55c already deleted. [ 746.948312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d712ce5-5cea-4d16-b243-a8c4d3b9d55c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.805843] env[65080]: INFO networking_nsxv3.common.synchronization [None req-2f0e134a-9c2b-4e27-bfe4-83cc55e30f9a tempest-ServersV294TestFqdnHostnames-1569834486 tempest-ServersV294TestFqdnHostnames-1569834486-project-member] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 747.806552] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 747.806964] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.807133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.807210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.807704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.807823] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.876047] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 in Status: SUCCESS [ 747.876047] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 deletion is rescheduled due to dependency. [ 747.876047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.901526] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7336014c-9b97-4d2c-8e38-3897e331154e tempest-ServersV294TestFqdnHostnames-1569834486 tempest-ServersV294TestFqdnHostnames-1569834486-project-member] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 747.903494] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 747.907069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.907069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.238394] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 748.238622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.238784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.239016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.239212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.239329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.239394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.239545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.239627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.239711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.239968] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.330760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.330760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.330760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.331156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.331156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.331156] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 already deleted. [ 748.331156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.331295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.331380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.331468] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.527199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 748.527525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.743183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.743183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.743432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.743432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.743696] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.743765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.743765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.743923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.744019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.744107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.744249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.744403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.744481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.744616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.744774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.744857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.744909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.745316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.745316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.745316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.745452] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.853255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.854775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.854775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.854775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.854977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.854977] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 already deleted. [ 748.855048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.140530] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9f7a0bb5-f2e2-4319-a579-a6126c5352f9 None None] Enqueued Resource ID: 20fe5db3-cb39-41a8-9ab9-17be36d7296e with Priority: HIGHEST for action port [ 749.140788] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20fe5db3-cb39-41a8-9ab9-17be36d7296e with Priority: HIGHEST for action port [ 749.141347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-20fe5db3-cb39-41a8-9ab9-17be36d7296e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.141458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20fe5db3-cb39-41a8-9ab9-17be36d7296e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.141595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20fe5db3-cb39-41a8-9ab9-17be36d7296e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.141772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20fe5db3-cb39-41a8-9ab9-17be36d7296e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.141856] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20fe5db3-cb39-41a8-9ab9-17be36d7296e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.249988] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for defc6278-7bc8-46f9-a983-ce92624f663f: rpc.has_security_group_logging(os_id): False [ 749.277008] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277008] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.277923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.277923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.278384] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.278611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.278777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.279871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.280056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.280253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.280370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.280465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.280708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.280708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.280893] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.281023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.281541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.281541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.281541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.281541] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be created. [ 749.355580] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.355738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.355834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.356065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.356264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 749.647752] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20fe5db3-cb39-41a8-9ab9-17be36d7296e [ 749.647752] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.647752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.647752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.647752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.647752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.647752] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20fe5db3-cb39-41a8-9ab9-17be36d7296e already deleted. [ 749.647752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20fe5db3-cb39-41a8-9ab9-17be36d7296e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.587919] env[65080]: INFO networking_nsxv3.common.synchronization [req-e220bb5a-8075-4d97-b4f9-1f943d08a56d req-4201e1fe-b09e-4a4d-9eb3-3a78a84aab4d tempest-ServersNegativeTestJSON-1863572029 tempest-ServersNegativeTestJSON-1863572029-project-member] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 750.587919] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 750.588271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.588271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.589099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.589099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.589099] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.589099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.589099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.591256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.591256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.591256] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.093387] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.395580] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 751.395580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.598418] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.100387] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.100617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.100715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.101014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.101160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.101311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 752.134232] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.134363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.134466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.134759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.134905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.144523] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 753.092887] env[65080]: INFO networking_nsxv3.common.synchronization [None req-57f46a74-7a87-4757-aa8c-d38e83f3e1fb None None] Enqueued Resource ID: 6e62f537-32c1-40b1-976f-c39ec9c5ec5a with Priority: HIGHEST for action port [ 753.093208] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e62f537-32c1-40b1-976f-c39ec9c5ec5a with Priority: HIGHEST for action port [ 753.093902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e62f537-32c1-40b1-976f-c39ec9c5ec5a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.100151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e62f537-32c1-40b1-976f-c39ec9c5ec5a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.100151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e62f537-32c1-40b1-976f-c39ec9c5ec5a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.100400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e62f537-32c1-40b1-976f-c39ec9c5ec5a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.100491] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e62f537-32c1-40b1-976f-c39ec9c5ec5a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.549622] env[65080]: INFO networking_nsxv3.common.synchronization [req-eed7b47e-b56b-4b44-ab65-ecefa1f13c10 req-966796b6-6eac-4328-888a-70b5b47eec80 tempest-ListImageFiltersTestJSON-1314988663 tempest-ListImageFiltersTestJSON-1314988663-project-member] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 753.551328] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 753.551885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.552163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.552491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.552777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.553196] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.553322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.553433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.553715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.553892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.554047] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.604029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e62f537-32c1-40b1-976f-c39ec9c5ec5a [ 753.604270] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.604417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.604496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.604719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.604805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.605087] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e62f537-32c1-40b1-976f-c39ec9c5ec5a already deleted. [ 753.605087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e62f537-32c1-40b1-976f-c39ec9c5ec5a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.058979] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.160234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 754.160500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.573097] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.638768] env[65080]: INFO networking_nsxv3.common.synchronization [None req-911aa308-8f9c-43e4-b4a4-2a9f1eb0907b tempest-ServersTestBootFromVolume-713779798 tempest-ServersTestBootFromVolume-713779798-project-member] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 754.644051] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 754.644352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.644488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.644551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.646533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.646646] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.890010] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d446a530-d5c9-4958-a318-cec4483289e5 tempest-ServersTestBootFromVolume-713779798 tempest-ServersTestBootFromVolume-713779798-project-member] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 754.890010] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 754.890010] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.890010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.077569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.077955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.077955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.078818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.078818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.078818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be updated. [ 755.127885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.129160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.129160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.129160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.129160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.144086] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 755.186845] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.187259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.187259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.187259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.187368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.187398] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 already deleted. [ 755.187476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.187998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.188196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.190771] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.510420] env[65080]: INFO networking_nsxv3.common.synchronization [None req-e63bc033-d5ed-4cd0-8787-a5578e6e5956 None None] Enqueued Resource ID: 35509192-e9f1-473c-86e1-f16f85eee02e with Priority: HIGHEST for action port [ 755.510420] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35509192-e9f1-473c-86e1-f16f85eee02e with Priority: HIGHEST for action port [ 755.510420] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-35509192-e9f1-473c-86e1-f16f85eee02e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.510420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35509192-e9f1-473c-86e1-f16f85eee02e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.510420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35509192-e9f1-473c-86e1-f16f85eee02e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.510420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35509192-e9f1-473c-86e1-f16f85eee02e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.510420] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35509192-e9f1-473c-86e1-f16f85eee02e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.658244] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a56311f-6edc-4721-819e-fad7bd03cb90 req-b7ff09b3-0932-4639-ad4d-2f9fedf2fbc7 tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 755.658988] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 755.659669] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.659829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.659940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.660262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.660428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.660532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.660587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.660802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.660965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.662020] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.722034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.722034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.722034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.722034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.722398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.722398] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 already deleted. [ 755.722523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.014535] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35509192-e9f1-473c-86e1-f16f85eee02e [ 756.014823] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.014999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.015106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.015670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.015670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.015670] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35509192-e9f1-473c-86e1-f16f85eee02e already deleted. [ 756.015670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35509192-e9f1-473c-86e1-f16f85eee02e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.110905] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.111054] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.112416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.112416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.112416] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.112416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.112416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.112628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.112628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.112834] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.112904] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.113029] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.113455] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.113455] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.113567] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.113766] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.137591] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.137769] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.137942] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.138334] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.138495] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-c5b9d995-d773-4439-ba7a-4043ad06b686 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.138702] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.138878] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.139189] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.139345] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b9d995-d773-4439-ba7a-4043ad06b686',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.164131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.164560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.164560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.164690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.164690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.164971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.165098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.165218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.165487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.165487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.165644] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf already deleted. [ 756.165644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.646833] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.646833] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port c5b9d995-d773-4439-ba7a-4043ad06b686 not found, creating... [ 756.646833] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.646833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.647609] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.647609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.647609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.647609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.647609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.647609] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: c5b9d995-d773-4439-ba7a-4043ad06b686 is going to be created. [ 756.670689] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.671051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.671224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.671607] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.671889] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.672227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.154846] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 757.155091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.403888] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a56311f-6edc-4721-819e-fad7bd03cb90 req-c35e2f25-a361-46e3-9bdf-2fdde38ac8d0 service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 757.403888] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a56311f-6edc-4721-819e-fad7bd03cb90 req-c35e2f25-a361-46e3-9bdf-2fdde38ac8d0 service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 757.404130] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a56311f-6edc-4721-819e-fad7bd03cb90 req-c35e2f25-a361-46e3-9bdf-2fdde38ac8d0 service nova] Enqueued Resource ID: c5b9d995-d773-4439-ba7a-4043ad06b686 with Priority: HIGHEST for action port [ 757.404674] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 757.404805] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 757.405057] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b9d995-d773-4439-ba7a-4043ad06b686 with Priority: HIGHEST for action port [ 757.410017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.410017] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.410017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.410017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.410017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.410581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.410581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.410830] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.411856] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b9d995-d773-4439-ba7a-4043ad06b686 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.411975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.412079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.412259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.412351] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b9d995-d773-4439-ba7a-4043ad06b686',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.914389] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.916815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.916815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.916815] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5b9d995-d773-4439-ba7a-4043ad06b686 with status ACTIVE [ 757.916815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.916815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.916815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.917151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.917151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.917434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.917497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.917685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.917743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.917861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.918111] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.918233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.918299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.918425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.918501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.918587] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5b9d995-d773-4439-ba7a-4043ad06b686 is going to be updated. [ 757.944509] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.944509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b9d995-d773-4439-ba7a-4043ad06b686" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.420473] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.923655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.924130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.924130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.924248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.924314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.924430] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be created. [ 758.954180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.954180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.954180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.954180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.954180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.969901] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: UNINITIALIZED for 2s [ 760.370338] env[65080]: INFO networking_nsxv3.common.synchronization [req-4eca9636-3232-4f4f-bfa6-c701df99047d req-8f6a4a2e-0a35-4633-a273-ce40233e2ec4 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 760.370880] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 760.371212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.371336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.371586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.371815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.371987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.372115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.372177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.372336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.372424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.372524] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.743064] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b45c9ea8-019e-4a64-85f6-8a2bfa7e31a8 None None] Enqueued Resource ID: d5b11da3-cf15-451c-a229-3e796d8a2ecb with Priority: HIGHEST for action port [ 760.744109] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b11da3-cf15-451c-a229-3e796d8a2ecb with Priority: HIGHEST for action port [ 760.746150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5b11da3-cf15-451c-a229-3e796d8a2ecb taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.746310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5b11da3-cf15-451c-a229-3e796d8a2ecb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.746510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5b11da3-cf15-451c-a229-3e796d8a2ecb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.747187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5b11da3-cf15-451c-a229-3e796d8a2ecb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.747187] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5b11da3-cf15-451c-a229-3e796d8a2ecb',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.875648] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.993849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 760.994067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.995176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.995482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.995729] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.995954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.996037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.996296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.996436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.996554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.996692] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.249452] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5b11da3-cf15-451c-a229-3e796d8a2ecb [ 761.249949] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.249949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.249949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.250317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.250421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.250522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5b11da3-cf15-451c-a229-3e796d8a2ecb already deleted. [ 761.250606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5b11da3-cf15-451c-a229-3e796d8a2ecb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.379685] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.500677] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.541644] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.542128] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.542128] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.542251] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.542509] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.543847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.544171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.544623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.544698] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.544880] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.544981] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.545116] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.545261] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.545378] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.545482] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.545611] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.568912] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.568912] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.568912] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.568912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-749" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.568912] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-112314e3-7960-4220-ab78-0cdd5ab158ea taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.568912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.568912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.568912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.568912] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112314e3-7960-4220-ab78-0cdd5ab158ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.885623] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.886829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.886829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.887046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.887114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.887167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 761.918091] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.918278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.918324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.918533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.918685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.928364] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 762.003749] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65229547-ee66-4305-8bfe-45dde2354faf: rpc.has_security_group_logging(os_id): False [ 762.024506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.024873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.025132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.025684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.025943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.026256] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.026502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.026502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.026688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.026771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.026898] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be created. [ 762.072106] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.072106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.072106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.072106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.072106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.072106] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 112314e3-7960-4220-ab78-0cdd5ab158ea not found, creating... [ 762.072106] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.073056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.073056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.073056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.073183] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.073392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.073392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.073659] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073883] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.074192] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 112314e3-7960-4220-ab78-0cdd5ab158ea is going to be created. [ 762.110040] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.110332] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.110405] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.110675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.110892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111126] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.113048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.113048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.113220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.113272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.113447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.129032] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [req-4eca9636-3232-4f4f-bfa6-c701df99047d req-b3febd49-24ca-40b9-82db-34b62093d113 service nova] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [req-4eca9636-3232-4f4f-bfa6-c701df99047d req-b3febd49-24ca-40b9-82db-34b62093d113 service nova] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [req-4eca9636-3232-4f4f-bfa6-c701df99047d req-b3febd49-24ca-40b9-82db-34b62093d113 service nova] Enqueued Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 762.827097] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 762.828279] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.828525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.829874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.830274] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.832409] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.832557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.832814] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-112314e3-7960-4220-ab78-0cdd5ab158ea taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.832936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.834581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.834581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.834581] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112314e3-7960-4220-ab78-0cdd5ab158ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.070804] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d3c7ceb4-8a50-420a-9474-a89d070f7e1b None None] Enqueued Resource ID: b6f0bd89-21d3-4450-b5e8-f8ecb41da740 with Priority: HIGHEST for action port [ 763.071451] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f0bd89-21d3-4450-b5e8-f8ecb41da740 with Priority: HIGHEST for action port [ 763.071792] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f0bd89-21d3-4450-b5e8-f8ecb41da740 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.071932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f0bd89-21d3-4450-b5e8-f8ecb41da740" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.072000] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f0bd89-21d3-4450-b5e8-f8ecb41da740" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.073017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f0bd89-21d3-4450-b5e8-f8ecb41da740" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.073131] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f0bd89-21d3-4450-b5e8-f8ecb41da740',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.322170] env[65080]: INFO networking_nsxv3.common.synchronization [req-986bb9a7-30d2-424b-b4f4-32287a36d67a req-b9917685-743e-4c20-84bc-7c41ebeb175e tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 763.326024] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 763.326024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.326024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.326024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.326024] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.332663] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.332768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.336146] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 112314e3-7960-4220-ab78-0cdd5ab158ea with status ACTIVE [ 763.336362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.336521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.337644] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.337644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.337644] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.338098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.338098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.338098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.338098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.338098] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 112314e3-7960-4220-ab78-0cdd5ab158ea is going to be updated. [ 763.365578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.366127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.366300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.367050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.367050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.367050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.576397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6f0bd89-21d3-4450-b5e8-f8ecb41da740 [ 763.576601] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.576749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.577179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.577315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.577636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.577762] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6f0bd89-21d3-4450-b5e8-f8ecb41da740 already deleted. [ 763.577854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f0bd89-21d3-4450-b5e8-f8ecb41da740" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.779640] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.779776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.780084] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.780519] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.780891] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.781217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.781266] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.781598] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.782438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.782438] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.782438] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.782538] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.783015] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.783015] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.783015] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.783015] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.806137] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.806285] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.806441] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.808183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.808183] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.808183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.808183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.808183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.809532] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('831c2c51-e86c-4986-a4c9-dc09a6a57fbd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.826918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.827462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.827725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.827875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.828127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.828273] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.828399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.828490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.828710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.828907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.829051] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d already deleted. [ 763.829289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.942024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.942024] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.146036] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 764.146238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.312690] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.312942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.313075] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.313370] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.313515] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.313676] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 831c2c51-e86c-4986-a4c9-dc09a6a57fbd not found, creating... [ 764.314042] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.314420] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.314547] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.314801] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.314959] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.315967] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.316215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.316389] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.316807] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.316890] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.317247] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 831c2c51-e86c-4986-a4c9-dc09a6a57fbd is going to be created. [ 764.338509] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.338749] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.338926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.339260] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.339910] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.340224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.447155] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.951752] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.035229] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7a531ff1-2a87-4ad3-b866-d82f53828ec5 tempest-ServersTestJSON-694710217 tempest-ServersTestJSON-694710217-project-member] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 765.036061] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 765.036428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.036583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.036679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.036966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.037100] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [req-986bb9a7-30d2-424b-b4f4-32287a36d67a req-8420c611-c4a8-4cbf-a57e-8cecbdc61ff8 service nova] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [req-986bb9a7-30d2-424b-b4f4-32287a36d67a req-8420c611-c4a8-4cbf-a57e-8cecbdc61ff8 service nova] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [req-986bb9a7-30d2-424b-b4f4-32287a36d67a req-8420c611-c4a8-4cbf-a57e-8cecbdc61ff8 service nova] Enqueued Resource ID: 831c2c51-e86c-4986-a4c9-dc09a6a57fbd with Priority: HIGHEST for action port [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 765.112353] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 831c2c51-e86c-4986-a4c9-dc09a6a57fbd with Priority: HIGHEST for action port [ 765.112353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.112572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.112635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.112864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.112952] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.113875] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.114083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.114167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.114351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.114632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.114747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.114805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.114961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.115064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.115158] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.116232] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.116410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.116410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.116582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.116683] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('831c2c51-e86c-4986-a4c9-dc09a6a57fbd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.306129] env[65080]: INFO networking_nsxv3.common.synchronization [None req-334c343e-751f-4ddd-a90b-ca002f9e76c9 tempest-ServersTestJSON-694710217 tempest-ServersTestJSON-694710217-project-member] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 765.306568] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 765.306886] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.306978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.455320] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.455483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.455554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.455814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.455878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.456026] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 765.490084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.490330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.490330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.490522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.490666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.503514] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 765.558259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.558605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.558605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.558754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.558754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.558863] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 already deleted. [ 765.558915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.559087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.559247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.559332] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.576565] env[65080]: INFO networking_nsxv3.common.synchronization [req-dfdc3abb-6e5b-46d1-8727-5de20a9a7c0f req-b63f32bf-281f-490a-9e88-a2aa05fa1782 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 765.578646] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 765.579443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.579443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.579443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.579702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.580287] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.580287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.580287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.580287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.580504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.581091] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.619040] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.620305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.620305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.623851] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 831c2c51-e86c-4986-a4c9-dc09a6a57fbd with status ACTIVE [ 765.624208] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.624554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.624760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.625421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.625541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.627436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.627436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.627436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.627436] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 831c2c51-e86c-4986-a4c9-dc09a6a57fbd is going to be updated. [ 765.650856] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.651057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.651165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.651403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.651629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.651933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-831c2c51-e86c-4986-a4c9-dc09a6a57fbd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.086361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.086807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.086807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.087716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.087863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.088049] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 already deleted. [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.091458] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.091458] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.091458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.092634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.092634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.092634] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a already deleted. [ 766.092634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.122302] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.161763] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-247 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.161917] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.164768] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.164768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.164768] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.164768] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.164768] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.164768] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.164768] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.164768] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.164768] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.188275] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.188469] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.188581] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.188735] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.189218] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.189345] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.189421] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.189724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.189855] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdca470f-e898-4264-bdd9-dcbcc4bd8e41',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.623495] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.623658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.623733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.623997] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.624108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.624228] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be created. [ 766.649034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.649776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.649776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.649841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.649996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.663916] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: UNINITIALIZED for 2s [ 766.696009] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.696425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.696606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.696986] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.697186] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.697350] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port cdca470f-e898-4264-bdd9-dcbcc4bd8e41 not found, creating... [ 766.697664] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.698510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.698510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.698510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.698510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.699496] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.699661] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.699808] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.700070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.700212] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.701192] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: cdca470f-e898-4264-bdd9-dcbcc4bd8e41 is going to be created. [ 766.726188] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.726415] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.726533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.726814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.727052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.727291] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.401855] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.402157] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.427287] env[65080]: INFO networking_nsxv3.common.synchronization [req-dfdc3abb-6e5b-46d1-8727-5de20a9a7c0f req-da6ce930-f710-438b-9059-dc2355899cb9 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 767.427458] env[65080]: INFO networking_nsxv3.common.synchronization [req-dfdc3abb-6e5b-46d1-8727-5de20a9a7c0f req-da6ce930-f710-438b-9059-dc2355899cb9 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 767.427797] env[65080]: INFO networking_nsxv3.common.synchronization [req-dfdc3abb-6e5b-46d1-8727-5de20a9a7c0f req-da6ce930-f710-438b-9059-dc2355899cb9 service nova] Enqueued Resource ID: cdca470f-e898-4264-bdd9-dcbcc4bd8e41 with Priority: HIGHEST for action port [ 767.427797] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 767.427983] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 767.428042] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdca470f-e898-4264-bdd9-dcbcc4bd8e41 with Priority: HIGHEST for action port [ 767.428578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.428695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.429617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.429617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.429617] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.430123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.430123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.430192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.431362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.431362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.431362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.431362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.431362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.431362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.431362] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.432048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.432048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.432048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.432194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.432283] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdca470f-e898-4264-bdd9-dcbcc4bd8e41',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.513423] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 767.513666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.513891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.514121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.514317] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.514431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.514493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.514649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.514755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.514847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.514941] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.935850] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.935850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.935850] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.938634] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdca470f-e898-4264-bdd9-dcbcc4bd8e41 with status ACTIVE [ 767.939738] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.939738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.939738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.939738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939738] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.939738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.940078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.940078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.940137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.940365] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.940493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.940558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.940725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.940854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.940918] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdca470f-e898-4264-bdd9-dcbcc4bd8e41 is going to be updated. [ 767.965389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.965536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.965610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.966076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.966206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.966401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdca470f-e898-4264-bdd9-dcbcc4bd8e41" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.017248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.017441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.017575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.017735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.018368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.018368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.018368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.018368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.018986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.018986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.018986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.018986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.018986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.018986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.019514] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.019514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.019514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.019514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.019514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.019514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.020037] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.238135] env[65080]: INFO networking_nsxv3.common.synchronization [req-fd25cac3-b55b-4130-a02a-a0597dd68729 req-2595e0d5-b7e5-4b71-880c-81b90f3f3c76 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 768.238721] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 768.239443] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.239663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.444019] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.521830] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 768.540803] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.540977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.541066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.541323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.541424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.541625] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.541766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.541825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.541992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.542090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.542318] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.542421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.542659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.542659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.542765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.542904] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.542996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.543073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.543260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.543342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.543429] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 768.608051] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-247 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.608247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.608247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.608466] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.609572] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.609572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.609572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.609572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.609811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.609910] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.610022] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.610124] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.610462] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.610580] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.610679] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.610806] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.613741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.613910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.613961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.614170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.614989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.627045] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 768.635301] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.636497] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.636497] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.636497] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.636497] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-a8b222e3-bc79-417c-aa18-98b3e8d23d09 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.636497] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.636947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.636947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.637128] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b222e3-bc79-417c-aa18-98b3e8d23d09',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.674728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 768.675022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.675220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.675443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.675645] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.675767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.675834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.676020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.676102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.676213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.676316] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.915846] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9d1ed906-341d-4bbd-9af2-376fdffd961b None None] Enqueued Resource ID: 0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569 with Priority: HIGHEST for action port [ 768.916647] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569 with Priority: HIGHEST for action port [ 768.917105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.917298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.917409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.917771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.917919] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.950957] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.951214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.951295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.951520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.951617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.951793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be created. [ 768.980872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.981112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.981283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.981798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.992514] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: UNINITIALIZED for 2s [ 769.139763] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.139975] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.140113] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.140390] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.140543] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.140696] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port a8b222e3-bc79-417c-aa18-98b3e8d23d09 not found, creating... [ 769.140959] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.141158] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.141271] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.141481] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.141610] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.141884] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.142156] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.142156] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.142341] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.142467] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.142607] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: a8b222e3-bc79-417c-aa18-98b3e8d23d09 is going to be created. [ 769.167252] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.167252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.167503] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.167926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.168328] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.169325] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.178719] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.421066] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569 [ 769.421204] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.421297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.421401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.422146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.422146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.422146] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569 already deleted. [ 769.422146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0979c5d0-9ea9-4a57-9afb-6b6ed7cc3569" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.682073] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0ec527d-b1df-4719-9613-729c01dff53d: rpc.has_security_group_logging(os_id): False [ 769.703795] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.704149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.704249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.704469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.704561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.704852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.704929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.704960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.705172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.705253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.705339] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be created. [ 769.767082] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.767082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.767082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.767082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.767647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.779621] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 769.869938] env[65080]: INFO networking_nsxv3.common.synchronization [req-e6f69afd-5314-4709-b382-8c8cd888ec22 req-eb8a8517-8b4e-4683-83dd-77fcc676fcd5 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 769.870582] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 769.870965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.872030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.872030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.872308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.872308] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.911162] env[65080]: INFO networking_nsxv3.common.synchronization [req-fd25cac3-b55b-4130-a02a-a0597dd68729 req-08e2f4e5-c6e6-45c8-acd7-64054894b2f6 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 769.911567] env[65080]: INFO networking_nsxv3.common.synchronization [req-fd25cac3-b55b-4130-a02a-a0597dd68729 req-08e2f4e5-c6e6-45c8-acd7-64054894b2f6 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 769.911567] env[65080]: INFO networking_nsxv3.common.synchronization [req-fd25cac3-b55b-4130-a02a-a0597dd68729 req-08e2f4e5-c6e6-45c8-acd7-64054894b2f6 service nova] Enqueued Resource ID: a8b222e3-bc79-417c-aa18-98b3e8d23d09 with Priority: HIGHEST for action port [ 769.912165] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 769.912346] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 769.912470] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8b222e3-bc79-417c-aa18-98b3e8d23d09 with Priority: HIGHEST for action port [ 769.912833] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.912894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.913072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.913196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.913359] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8b222e3-bc79-417c-aa18-98b3e8d23d09 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.913458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.913521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.915544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.915544] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b222e3-bc79-417c-aa18-98b3e8d23d09',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.376734] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.377122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.377267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.377501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.377745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.377963] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.378119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.378119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.378567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.378695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.378803] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 770.414066] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.414280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.414280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.414649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.414852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.418116] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8b222e3-bc79-417c-aa18-98b3e8d23d09 with status ACTIVE [ 770.418461] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.420928] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.420928] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.420928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.420928] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8b222e3-bc79-417c-aa18-98b3e8d23d09 is going to be updated. [ 770.430436] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 770.446717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.446933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.447049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.447955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.447955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.447955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8b222e3-bc79-417c-aa18-98b3e8d23d09" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.644246] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 770.644246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.003653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 771.003960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.003960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.004368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.004368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.004495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.004530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.004667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.004751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.004836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.004961] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.005858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.007406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.007406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.007406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.007406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.007406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.007665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.007665] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.289147] env[65080]: INFO networking_nsxv3.common.synchronization [None req-06dc7e75-c989-438b-90a8-79cdbfb41d2a None None] Enqueued Resource ID: a7187f55-e267-40be-9ca9-5c51f94cb592 with Priority: HIGHEST for action port [ 771.289970] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7187f55-e267-40be-9ca9-5c51f94cb592 with Priority: HIGHEST for action port [ 771.290120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7187f55-e267-40be-9ca9-5c51f94cb592 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.290280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7187f55-e267-40be-9ca9-5c51f94cb592" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.290280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7187f55-e267-40be-9ca9-5c51f94cb592" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.296230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7187f55-e267-40be-9ca9-5c51f94cb592" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.296230] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7187f55-e267-40be-9ca9-5c51f94cb592',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.510678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.510891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.511189] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.796204] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 771.796460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.798976] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7187f55-e267-40be-9ca9-5c51f94cb592 [ 771.799130] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.800309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.800309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.800309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.800309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.800309] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7187f55-e267-40be-9ca9-5c51f94cb592 already deleted. [ 771.800309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7187f55-e267-40be-9ca9-5c51f94cb592" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.015062] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.443175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 772.443175] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 772.443263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.518832] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.518994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.519072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.519292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.519383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.519483] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 772.565545] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.565654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.565749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.565925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.566105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.575728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 773.281270] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 773.281585] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 773.281884] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 773.282793] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 773.283220] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.283418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.283529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.283806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.284127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.284275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.284375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.284577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.284710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.285486] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.286154] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.286347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.286458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.286702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.286917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.288923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.288923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.288923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.288923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.288923] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.336787] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 773.338814] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 773.339141] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_rules [ 773.339375] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 773.339568] env[65080]: INFO networking_nsxv3.common.synchronization [req-57f9b740-2f6a-481d-8f83-e54e78b8df05 req-1da4354e-5ae4-4f33-80db-f99f9c8fff31 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 773.340297] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 773.340573] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_rules [ 773.340732] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 773.340882] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 773.341033] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 773.342014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.342250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.342365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.342652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.342817] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.346052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.346052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.346052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.346283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.346336] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.347242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-112314e3-7960-4220-ab78-0cdd5ab158ea taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.347420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.347420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.348305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.348305] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112314e3-7960-4220-ab78-0cdd5ab158ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.349261] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.349261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.350093] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.350093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.789188] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.790607] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.851078] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.851226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.851482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.851644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.851808] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 112314e3-7960-4220-ab78-0cdd5ab158ea with status ACTIVE [ 773.851992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.852118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.852188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.852521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.852608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.852798] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.852938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.853052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.853415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.853415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.853548] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.853598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.853637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.853779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.853853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.853956] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 112314e3-7960-4220-ab78-0cdd5ab158ea is going to be updated. [ 773.883654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.883857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.884788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.884788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.884788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.884788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.291791] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.293461] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.587136] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 774.587404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.587609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.587867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.588151] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.588320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.588398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.588567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.588678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.588807] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.795234] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.795411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.795465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.795688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.795764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.795869] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 774.797262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.797375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.798882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.799194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.799295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.799445] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be created. [ 774.829959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.829959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.829959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.830425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.830458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.835215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.835215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.835215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.835215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.835215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.843354] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: UNINITIALIZED for 2s [ 774.844118] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 775.005213] env[65080]: INFO networking_nsxv3.common.synchronization [req-7acaee1a-cb22-479e-a5a5-13ad9b4d0ddd req-a4690199-c9b2-400b-b1d0-f251bfa981ff tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 775.005213] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 775.005695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.006050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.006256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.006676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.006989] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.007396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.007700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.008076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.008358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.008619] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.092521] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.369625] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.370298] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.370298] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.370298] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.370573] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.370639] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.370717] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.370928] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.371572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.371840] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.371977] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.372160] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.372598] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.372598] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.372781] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.373043] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.396379] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.396501] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.396612] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.396777] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.397103] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-4c097644-8b4b-43ca-87bf-d8fa57586bdf taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.397290] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.397377] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.397741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.397879] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c097644-8b4b-43ca-87bf-d8fa57586bdf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.514088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.514088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.514088] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 already deleted. [ 775.514088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.594547] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.753019] env[65080]: INFO networking_nsxv3.common.synchronization [None req-15374ff4-4a9c-4569-bdaa-fc2cf0fd883d None None] Enqueued Resource ID: bd2ebe0f-e001-4de9-bb4f-f06adf58cea1 with Priority: HIGHEST for action port [ 775.753019] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd2ebe0f-e001-4de9-bb4f-f06adf58cea1 with Priority: HIGHEST for action port [ 775.753260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd2ebe0f-e001-4de9-bb4f-f06adf58cea1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.753260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd2ebe0f-e001-4de9-bb4f-f06adf58cea1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.753260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd2ebe0f-e001-4de9-bb4f-f06adf58cea1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.753704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd2ebe0f-e001-4de9-bb4f-f06adf58cea1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.753704] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd2ebe0f-e001-4de9-bb4f-f06adf58cea1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.903066] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.903066] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 4c097644-8b4b-43ca-87bf-d8fa57586bdf not found, creating... [ 775.903066] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.903066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.903558] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.903558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.903558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.903558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.903558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.903558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 4c097644-8b4b-43ca-87bf-d8fa57586bdf is going to be created. [ 775.925863] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.925863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.925863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.925863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.925863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.925863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.097474] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.097474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.097474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.097474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.097474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.097787] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 776.145791] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.145791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.145791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.146014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.146178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.157125] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 776.257920] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd2ebe0f-e001-4de9-bb4f-f06adf58cea1 [ 776.257920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.258182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.258182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.258761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.258761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.258761] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd2ebe0f-e001-4de9-bb4f-f06adf58cea1 already deleted. [ 776.258761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd2ebe0f-e001-4de9-bb4f-f06adf58cea1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.687513] env[65080]: INFO networking_nsxv3.common.synchronization [req-7acaee1a-cb22-479e-a5a5-13ad9b4d0ddd req-f3558cff-16ba-4790-b5d9-08f5f8105b31 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 776.687739] env[65080]: INFO networking_nsxv3.common.synchronization [req-7acaee1a-cb22-479e-a5a5-13ad9b4d0ddd req-f3558cff-16ba-4790-b5d9-08f5f8105b31 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 776.688540] env[65080]: INFO networking_nsxv3.common.synchronization [req-7acaee1a-cb22-479e-a5a5-13ad9b4d0ddd req-f3558cff-16ba-4790-b5d9-08f5f8105b31 service nova] Enqueued Resource ID: 4c097644-8b4b-43ca-87bf-d8fa57586bdf with Priority: HIGHEST for action port [ 776.688540] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 776.688540] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 776.688841] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c097644-8b4b-43ca-87bf-d8fa57586bdf with Priority: HIGHEST for action port [ 776.688943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.689090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.689154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.689408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.689510] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.690354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.690467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.690531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.690697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.690834] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.690932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.690993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.691149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.691231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.691319] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.695920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c097644-8b4b-43ca-87bf-d8fa57586bdf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.695920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.695920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.696318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.696318] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c097644-8b4b-43ca-87bf-d8fa57586bdf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.858103] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 776.858545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.860521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.860521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.860521] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.861518] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 776.861754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.861931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.862147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.862347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.862460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.862544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.862720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.863360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.863360] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.199172] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.199172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.202340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c097644-8b4b-43ca-87bf-d8fa57586bdf with status ACTIVE [ 777.202679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.202804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.202860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.203047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.203123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.203293] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.203708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.203708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.203708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.203708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.203973] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.203973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.204222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.204409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.204409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.204527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c097644-8b4b-43ca-87bf-d8fa57586bdf is going to be updated. [ 777.206204] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.233152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.233152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.233152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.233152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.233152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.233152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c097644-8b4b-43ca-87bf-d8fa57586bdf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.366541] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.367866] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.709949] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.872804] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.873999] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.167887] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 778.168207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.169809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.169809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.171302] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.171302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.171302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.171302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.171302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.171302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.171302] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.213450] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.213450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.213450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.213450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.213679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.213679] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be created. [ 778.239025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.239025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.239025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.239243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.239584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.249434] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: UNINITIALIZED for 2s [ 778.376565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.376745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.376783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.377012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.377099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.377471] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be updated. [ 778.378820] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.378945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.379024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.379825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.379948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.380109] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 778.387769] env[65080]: INFO networking_nsxv3.common.synchronization [None req-686a1c8d-1c13-42d8-946a-3dd4eb06274f None None] Enqueued Resource ID: f4b27ee0-78b4-43ac-8f6b-828eec6ec60a with Priority: HIGHEST for action port [ 778.387769] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b27ee0-78b4-43ac-8f6b-828eec6ec60a with Priority: HIGHEST for action port [ 778.387769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4b27ee0-78b4-43ac-8f6b-828eec6ec60a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.387769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4b27ee0-78b4-43ac-8f6b-828eec6ec60a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.387769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4b27ee0-78b4-43ac-8f6b-828eec6ec60a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.387769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4b27ee0-78b4-43ac-8f6b-828eec6ec60a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.387769] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4b27ee0-78b4-43ac-8f6b-828eec6ec60a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.412710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.412710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.412932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.412967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.413114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.414892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.415022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.415103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.415256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.415381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.426420] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 778.427124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 778.675492] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 379c83f4-3ef4-4263-aff5-1c9a7750a19a: rpc.has_security_group_logging(os_id): False [ 778.697246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.697246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.697246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.697246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.697768] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.697768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.697768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.697768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.697768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.698926] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be created. [ 778.763961] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.764297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.764297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.764504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.764504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.777232] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 778.890420] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4b27ee0-78b4-43ac-8f6b-828eec6ec60a [ 778.891264] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.891264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.891264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.891264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.891264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.891576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4b27ee0-78b4-43ac-8f6b-828eec6ec60a already deleted. [ 778.891576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4b27ee0-78b4-43ac-8f6b-828eec6ec60a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.261407] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 780.261785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.261785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.262160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.262361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.262474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.262539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.262712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.262797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.262876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.262962] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.443076] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 780.443589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.444474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.444855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.446074] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.446535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.447607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.447607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.447607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.447875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.448124] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.451672] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 780.453710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.453710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.453710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.453710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.453710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.453710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.454669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.454669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.454669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.456787] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.765303] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.765513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.765655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.765789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.765973] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.766100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.766170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.766331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.766420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.766509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.766655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.766747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.766808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.766944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.767094] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.767206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.767263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.767406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.767487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.767567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.767658] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.792694] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 780.793026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.793718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.794061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.794217] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.951351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.951551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.951583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.951803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.952030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.952156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.952290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.952674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.953027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.953283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.953721] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.953961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.954068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.954244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.954417] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.954521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.954581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.954737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.954826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.954957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.955214] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.958234] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.269716] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756: rpc.has_security_group_logging(os_id): False [ 781.290296] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.290503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.290503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.290717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.290810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.291059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.291167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.291231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.291394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.291465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.291674] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.291809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.291902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.293327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.293414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.293649] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.293829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.293829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.294213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.294213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.294727] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be created. [ 781.297299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.297494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.298410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.298410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.298410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.298410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.298410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.298410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.298752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.298752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.298752] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.388551] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.388716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.388818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.388987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.389182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.405798] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 781.458309] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 781.459855] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27aecc9-ab87-4819-8111-15b950c38df6: rpc.has_security_group_logging(os_id): False [ 781.501233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.501632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.501778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.501974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.502086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.502417] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.502417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.502535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.502648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.502727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.502814] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be created. [ 781.505655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.505655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.505655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.505949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.506083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.506321] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.506462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.506551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.506744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.506855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.507127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.507435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.507585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.507771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.507881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.508128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.508265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.508351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.508731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.508852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.508971] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 781.607092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.607334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.607334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.607533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.607707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.621663] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.621850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.621902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.622149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.622298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.624014] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 781.643530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 781.654148] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7699928a-0584-4f66-b93b-d1a915092719 None None] Enqueued Resource ID: 26530601-da02-42ce-8240-d244d7aeadfc with Priority: HIGHEST for action port [ 781.654697] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26530601-da02-42ce-8240-d244d7aeadfc with Priority: HIGHEST for action port [ 781.655076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-26530601-da02-42ce-8240-d244d7aeadfc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.655219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26530601-da02-42ce-8240-d244d7aeadfc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.655279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26530601-da02-42ce-8240-d244d7aeadfc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.655508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26530601-da02-42ce-8240-d244d7aeadfc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.655587] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26530601-da02-42ce-8240-d244d7aeadfc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.801573] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.801573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.801573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.801942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.801942] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.802028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.802028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.802187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.802279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.802372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.802521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.802620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.802671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.802954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.803137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.803283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.803423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.803569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.803650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.803735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.803894] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.852016] env[65080]: INFO networking_nsxv3.common.synchronization [req-f5f47c23-2dee-4467-a133-70f793bc6297 req-8dd57899-8706-4b2d-8d7b-cd76a07d07a0 tempest-ServersTestFqdnHostnames-872778182 tempest-ServersTestFqdnHostnames-872778182-project-member] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 781.852640] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGHEST for action security_group_members [ 781.852971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.853139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.853203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.853384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.853575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.854026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.854026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.854123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.854201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.854329] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.158345] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26530601-da02-42ce-8240-d244d7aeadfc [ 782.158345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.158472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.158472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.158656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.158761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.158858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26530601-da02-42ce-8240-d244d7aeadfc already deleted. [ 782.159052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26530601-da02-42ce-8240-d244d7aeadfc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.307952] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 379c83f4-3ef4-4263-aff5-1c9a7750a19a: rpc.has_security_group_logging(os_id): False [ 782.339094] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.339285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.339355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.339661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.339786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.340050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.340228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.340363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.340537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.340642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.340888] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.341058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.341264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.341452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.341538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.341975] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.341975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.342174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.342233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.342357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.342500] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 782.356838] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.357124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.357124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.358131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.358131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.358131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.358131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.358131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.358131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.358728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.358728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce is going to be updated. [ 782.416021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.416021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.416021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.416021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.416021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.428148] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: IN_PROGRESS for 2s [ 782.455245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.455457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.455457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.455739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.455909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.477474] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 783.420858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 783.420858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.638053] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 783.638665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.655613] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 783.656044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.866763] env[65080]: INFO networking_nsxv3.common.synchronization [req-78f176b0-3b91-4f9b-9034-162f114f84f6 req-2439fddd-d255-4fcd-909a-7d1412cc4992 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 783.867488] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 783.867694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.868629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.868629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.868629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.868629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.868842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.868842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.869019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.869140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.869238] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.266198] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 784.266380] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 784.266652] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 784.267933] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 784.267933] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 784.267933] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 784.267933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.267933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.267933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.268293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.268882] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.269040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.269167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.269377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.269498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.269630] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.270812] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.270961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.271075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.271428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.271612] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.271746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.271894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.272971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.272971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.272971] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.273395] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.273715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.273715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.273715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.273855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.274149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.274149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.274248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.274296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.274488] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.314681] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 784.314897] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 784.315100] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_rules [ 784.315232] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 784.316314] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_rules [ 784.316314] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 784.316314] env[65080]: INFO networking_nsxv3.common.synchronization [req-279e5c04-90b1-493e-aa3a-42db67dfd59a req-cda56d9b-7dda-45ad-9685-ef21b30498e0 tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_rules [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_rules [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112314e3-7960-4220-ab78-0cdd5ab158ea with Priority: HIGHEST for action port [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_rules [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 784.322447] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 784.322447] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.322447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.322447] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.322447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.322447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.323052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.323052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.323052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-112314e3-7960-4220-ab78-0cdd5ab158ea taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.323052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.323295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.323295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.323362] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112314e3-7960-4220-ab78-0cdd5ab158ea',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.324366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.324502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.324577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.324732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.325348] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.326209] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.326325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.326702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.326803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.371822] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.437610] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2aca6290-771b-45ff-a84d-6dbf408cedce in Status: SUCCESS [ 784.438089] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce deletion is rescheduled due to dependency. [ 784.438089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.493527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 784.493742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.776810] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.777965] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.778956] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.829192] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 112314e3-7960-4220-ab78-0cdd5ab158ea with status ACTIVE [ 784.829522] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.829680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.829757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.829971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.830087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.830296] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.830420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.830462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.830605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.830680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.830863] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.830955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.831026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.831168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.831246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.831329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 112314e3-7960-4220-ab78-0cdd5ab158ea is going to be updated. [ 784.833127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.833241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.833453] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.833535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.837206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.837206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.867387] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.867550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.867673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.867811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.867961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.868163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112314e3-7960-4220-ab78-0cdd5ab158ea" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.877086] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.111725] env[65080]: INFO networking_nsxv3.common.synchronization [None req-42928ba6-0044-4eab-8deb-149499870fa8 None None] Enqueued Resource ID: 23d62ea6-a420-46e7-85d8-bf06f120e31c with Priority: HIGHEST for action port [ 785.112356] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23d62ea6-a420-46e7-85d8-bf06f120e31c with Priority: HIGHEST for action port [ 785.112686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-23d62ea6-a420-46e7-85d8-bf06f120e31c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.112879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23d62ea6-a420-46e7-85d8-bf06f120e31c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.112879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23d62ea6-a420-46e7-85d8-bf06f120e31c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.113183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23d62ea6-a420-46e7-85d8-bf06f120e31c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.113270] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23d62ea6-a420-46e7-85d8-bf06f120e31c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.280035] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.281012] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.281879] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.382459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.382459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.382459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.383368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.383368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.383368] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 785.419402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.420189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.420189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.420189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.420348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.432494] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 785.617041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23d62ea6-a420-46e7-85d8-bf06f120e31c [ 785.617041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.617041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.617041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.617041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.617041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.617041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23d62ea6-a420-46e7-85d8-bf06f120e31c already deleted. [ 785.617041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23d62ea6-a420-46e7-85d8-bf06f120e31c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.783293] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.786623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.786623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.786623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.786623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.786623] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 785.787511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.787511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.790023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.790023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.790023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.790023] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 is going to be created. [ 785.793195] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.793195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.793195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.793195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.793195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.793633] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be updated. [ 785.828631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.828854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.828932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.829755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.830043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.833204] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.833369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.833473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.833734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.833951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.840746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.840982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.841116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.841567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.841771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.847156] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 in Status: UNINITIALIZED for 2s [ 785.847967] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 785.850145] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 787.444933] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 787.444933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.861857] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.861857] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.861857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.861857] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.864105] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 787.864287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.864994] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 in Status: SUCCESS [ 787.865239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.865394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.865683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.865790] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.865925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.865993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.866189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.866277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.866393] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.867344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.867525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.867699] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.867827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.867893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.868162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.868200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.868309] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.372050] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.372050] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.372050] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.564158] env[65080]: INFO networking_nsxv3.common.synchronization [req-471967b9-2b81-467f-8d3d-00ccb040cdd8 req-3fff878a-3f1f-490c-9e25-1264415553ff tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 788.564506] env[65080]: INFO networking_nsxv3.common.synchronization [req-471967b9-2b81-467f-8d3d-00ccb040cdd8 req-3fff878a-3f1f-490c-9e25-1264415553ff tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 788.564506] env[65080]: INFO networking_nsxv3.common.synchronization [req-471967b9-2b81-467f-8d3d-00ccb040cdd8 req-3fff878a-3f1f-490c-9e25-1264415553ff tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 788.564980] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 788.565179] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGHEST for action security_group_members [ 788.565290] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 with Priority: HIGHEST for action security_group_members [ 788.565573] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.565675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.565857] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.565939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.566124] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.566205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.634870] env[65080]: INFO networking_nsxv3.common.synchronization [req-c6ed1002-9df3-4175-853b-a3ba1d5a400f req-89c848bd-3a6f-4644-8742-22bc172868b6 tempest-ServerActionsV293TestJSON-2025792179 tempest-ServerActionsV293TestJSON-2025792179-project-member] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 788.635517] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGHEST for action security_group_members [ 788.635821] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.635958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.636067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.636514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.636649] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.636755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.636953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.636953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.637225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.637225] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.877193] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.877497] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.878172] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.140014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.140231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.140231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.140577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.140640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.140851] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.140954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.141030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.141194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.141271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.141357] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a is going to be updated. [ 789.170014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.170266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.170336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.170550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.170712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.180565] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: IN_PROGRESS for 2s [ 789.380726] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.380726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.380726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.380726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.380726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.380726] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 789.382498] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.382747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.382902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.383164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.383334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.384796] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be updated. [ 789.384796] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.384796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.384796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.385020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.385190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.385190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 is going to be updated. [ 789.416776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.416931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.416980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.417238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.417381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.419191] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.419307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.419373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.419541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.419741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.421132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.421242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.421309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.421455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.421565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.431275] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 in Status: IN_PROGRESS for 2s [ 789.431912] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 789.432486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 791.194486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a in Status: SUCCESS [ 791.194993] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a deletion is rescheduled due to dependency. [ 791.195256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.444720] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 791.444925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.445729] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 in Status: SUCCESS [ 791.445878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.446504] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 791.446662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.446816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.447765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.447993] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.448141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.448209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.448371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.448439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.448532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.448628] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.449529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.449702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.450491] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.450491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.450491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.450491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.450491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.450491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.450491] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.453540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.453777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.453896] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.453994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.454512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.454512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.454512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.454675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.454675] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.455702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.455870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.456043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.456148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.456206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.458727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.458872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.459117] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.461189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.461296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.461906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.463828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.463921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.464164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.464264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.464350] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.465646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.465808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.465981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.466103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.466169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.466313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.466392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.466481] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.956488] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb93ebf0-2e1e-435f-9a22-61cb77ec84b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.957867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.957987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.962427] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.968783] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.969239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.969954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.971506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.971506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.971506] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be updated. [ 791.973616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.973616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.973616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.973792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.973792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.974788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.974788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.974788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.974788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.974788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.974788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 is going to be deleted. [ 791.976483] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.005451] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.006236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.009772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.009772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.009772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.021124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 792.049014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.051163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.051163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.051163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.051163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.051163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.460516] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb93ebf0-2e1e-435f-9a22-61cb77ec84b2: rpc.has_security_group_logging(os_id): False [ 792.466192] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.480311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27aecc9-ab87-4819-8111-15b950c38df6: rpc.has_security_group_logging(os_id): False [ 792.486884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.487082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.487143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.487349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.487437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.487679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.487786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.487854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.488094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.488094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.488201] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 is going to be created. [ 792.503478] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.504088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.504088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.504088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.504088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.504390] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.504390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.504592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.504592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.504755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.504755] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be updated. [ 792.514190] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2], does not exist path=[/infra/domains/default/groups/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2]."\n}' [ 792.514190] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 [ 792.514190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 792.582678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.583176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.583291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.584549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.585154] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.585154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.585600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.585886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.586029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.587051] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.587051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.587051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.587051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.587051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.588827] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 is going to be created. [ 792.601027] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.601027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.601027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.601027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.601297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622779] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: IN_PROGRESS for 2s [ 792.625509] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2], does not exist path=[/infra/domains/default/groups/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 [ 792.625856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb93ebf0-2e1e-435f-9a22-61cb77ec84b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.626377] env[65080]: Traceback (most recent call last): [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 792.626459] env[65080]: return func(*args, **kwargs) [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.626459] env[65080]: res.raise_for_status() [ 792.626459] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.626459] env[65080]: raise HTTPError(http_error_msg, response=self) [ 792.626459] env[65080]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 [ 792.626459] env[65080]: During handling of the above exception, another exception occurred: [ 792.626459] env[65080]: Traceback (most recent call last): [ 792.626459] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 792.626459] env[65080]: listener.cb(fileno) [ 792.626459] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 792.626459] env[65080]: result = function(*args, **kwargs) [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 792.626459] env[65080]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 792.626459] env[65080]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 792.626459] env[65080]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 792.626459] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.626459] env[65080]: res.raise_for_status() [ 792.626459] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.626459] env[65080]: raise HTTPError(http_error_msg, response=self) [ 792.627290] env[65080]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb93ebf0-2e1e-435f-9a22-61cb77ec84b2 [ 792.627290] env[65080]: Removing descriptor: 5 [ 792.968225] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.968225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.968225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.968225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.968225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 793.000835] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.001061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.001061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.001280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.001421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.011595] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 793.070601] env[65080]: INFO networking_nsxv3.common.synchronization [req-3d746ea5-3443-406b-8928-8bb62dd23162 req-1ede3fc6-5a35-4912-8de8-8b10d7caf221 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 793.073161] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 793.073635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.073830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.074060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.074246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.074329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.074498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.074564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.074744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.074925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.074996] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.473034] env[65080]: INFO networking_nsxv3.common.synchronization [req-af435fdb-39ae-40ad-93b4-7cf98b75ecb2 req-1c130809-0480-468d-88f8-6fc8e3ac4879 tempest-ListImageFiltersTestJSON-1314988663 tempest-ListImageFiltersTestJSON-1314988663-project-member] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 793.473034] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGHEST for action security_group_members [ 793.473034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.473774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.474141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.474482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.474748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.474931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.475239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.475473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.478480] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.580032] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.580032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.580032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.580032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.601515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.601778] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.601920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.601990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.602169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.602253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.602370] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 793.639478] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.639478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.639478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.639478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.639478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.649018] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 793.983244] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.983244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.983244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.983244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.004466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.004466] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.004466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.004466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.004466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.004466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.004466] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be updated. [ 794.036591] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.037267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.037267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.037267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.037267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.039269] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 794.039559] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 deletion is rescheduled due to dependency. [ 794.039783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.054241] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: IN_PROGRESS for 2s [ 794.339375] env[65080]: INFO networking_nsxv3.common.synchronization [req-01a6ffa5-9d85-4274-a43f-d81e874a062a req-27459774-397d-441d-b977-5e2092f528a2 tempest-ServerPasswordTestJSON-1244565361 tempest-ServerPasswordTestJSON-1244565361-project-member] Enqueued Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 794.339754] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 794.340084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.340216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.340288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.340556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.340715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.340819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.340881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.341131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.341232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.341329] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.348373] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.348527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.348570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.348782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.348891] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.613498] env[65080]: INFO networking_nsxv3.common.synchronization [None req-118584ab-f856-4980-8fc8-7711bd698aa7 None None] Enqueued Resource ID: 3dd560cf-7667-4d1f-aeb7-0b964027af6d with Priority: HIGHEST for action port [ 794.614196] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dd560cf-7667-4d1f-aeb7-0b964027af6d with Priority: HIGHEST for action port [ 794.615087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dd560cf-7667-4d1f-aeb7-0b964027af6d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.615272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dd560cf-7667-4d1f-aeb7-0b964027af6d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.615536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dd560cf-7667-4d1f-aeb7-0b964027af6d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.615627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dd560cf-7667-4d1f-aeb7-0b964027af6d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.615680] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dd560cf-7667-4d1f-aeb7-0b964027af6d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.636846] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27aecc9-ab87-4819-8111-15b950c38df6 in Status: SUCCESS [ 794.636948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.689179] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-77 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.689520] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-77" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.689520] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-77" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.689776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-77" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.690652] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.690652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.690652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.690652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.690944] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.691452] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.691452] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.691607] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.691782] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.691927] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.692095] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.692290] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.711888] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.712147] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.712147] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.712609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-77" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.712609] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.712812] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.712847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.713170] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.713302] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.844312] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.844312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.844312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.844461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.844461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.844708] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.844838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.844918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.845123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.845218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.845329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b already deleted. [ 794.845432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.850865] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.026020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.026020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.026020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.026020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.026020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.026878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.026878] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.119817] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dd560cf-7667-4d1f-aeb7-0b964027af6d [ 795.120105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.120248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.120317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.120550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.120638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.120749] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dd560cf-7667-4d1f-aeb7-0b964027af6d already deleted. [ 795.120829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dd560cf-7667-4d1f-aeb7-0b964027af6d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.217195] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.217195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.217195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.217195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.217195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.217832] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 not found, creating... [ 795.217832] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.217832] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.217832] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.218203] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.218282] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.218602] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.218764] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.219200] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.221419] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.221419] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.221419] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 is going to be created. [ 795.251799] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.252123] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.252493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.252634] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.252988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.253264] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.354323] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.529588] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 795.550218] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.550408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.550466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.550646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.570043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.570215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.570343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.570411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.570620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.570706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.571118] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.571118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.571118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.573496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.573496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.573679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.573784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.573847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.574009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.574151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.574259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 795.658274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.658686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.658686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.659389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.659389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.664749] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 795.664889] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 deletion is rescheduled due to dependency. [ 795.664990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.680894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 795.857129] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 795.857248] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 796.005187] env[65080]: INFO networking_nsxv3.common.synchronization [req-01a6ffa5-9d85-4274-a43f-d81e874a062a req-6d160c08-211d-437f-adfa-2ea14e69eb11 service nova] Enqueued Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_rules [ 796.005628] env[65080]: INFO networking_nsxv3.common.synchronization [req-01a6ffa5-9d85-4274-a43f-d81e874a062a req-6d160c08-211d-437f-adfa-2ea14e69eb11 service nova] Enqueued Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 796.005628] env[65080]: INFO networking_nsxv3.common.synchronization [req-01a6ffa5-9d85-4274-a43f-d81e874a062a req-6d160c08-211d-437f-adfa-2ea14e69eb11 service nova] Enqueued Resource ID: 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 with Priority: HIGHEST for action port [ 796.006485] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_rules [ 796.006485] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 796.006485] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 with Priority: HIGHEST for action port [ 796.006660] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.006725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.006768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.007800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.008963] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.010389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.010389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.010389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.010389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.010618] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.010618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.010618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.011083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.011083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.011083] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.012131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.012245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.012347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.012452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.012528] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.065707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e in Status: SUCCESS [ 796.066126] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e deletion is rescheduled due to dependency. [ 796.066690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.518021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518021] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.518021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 with status ACTIVE [ 796.518021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.518021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.518021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.518678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.518678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.518678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.519827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.520132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882 is going to be updated. [ 796.545635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.545987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.546172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.546483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.548894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.548894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b9ac5ff-0ac9-47c8-9b0a-782b9bd72882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.821428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.821826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.821826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.822893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.834671] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 796.837698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.838784] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 796.870353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.870353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.870353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.870586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.881912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.883015] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 796.883207] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.883405] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 796.926019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.926268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.926356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.927027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.927917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.928152] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 796.939960] env[65080]: INFO networking_nsxv3.common.synchronization [req-c3073a6a-c7db-4f55-91ca-a5b65c1969a6 req-8e5e71be-2e3d-40a1-beff-83e809e17871 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 796.940700] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGHEST for action security_group_members [ 796.941133] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.941305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.941433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.941764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.941957] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.942093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.942204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.942432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.942556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.942691] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.997702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.997875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.997921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.998116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.998357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.998511] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 797.023067] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.060760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.060760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.061063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.062480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.062480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.062480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 797.062480] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc6910c0-f6a2-426f-8968-cad99131eb9b', 'd4afef2a-fdec-49a9-a48d-5d83f81fd8bf', '379c83f4-3ef4-4263-aff5-1c9a7750a19a', '4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e', 'd0ec527d-b1df-4719-9613-729c01dff53d', '5dc61faf-26f7-4161-a835-ebac2e25ee27', '1ab0447d-1533-4bb0-a280-31ec2fa0ff60', '7a859d56-1200-4947-a281-afd910811864', '0b62ed3e-e617-4e8b-af7c-ff034e19bbec', 'cdc4df4f-1494-4be5-9f4c-02d2b0808e83', 'd5db4dff-67d7-4cc9-a39d-74b1615f620b', '7f49306d-9b39-4971-a2bc-404227491c8d', 'a0bed36f-2ea1-4c82-9859-63ef0d32d194', 'db21a227-1ffb-4e1a-8c5e-6d7e45c3755a', '724930a7-3e32-4bbf-8611-b93b2ddfe0f4', '4dfe941e-e110-4be2-8d6d-f400f514d0e5', 'c27aecc9-ab87-4819-8111-15b950c38df6', '2aca6290-771b-45ff-a84d-6dbf408cedce', '5205042a-83a4-497b-90f3-4c8bfbcc3a1d', '7235a15a-5182-42b0-892c-541ba160fba3', '6825ea0a-b872-4921-b4ff-cfadbcf5f615', '354ecbf4-79a8-4770-9da4-7284d1f205e7', '5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0', '65229547-ee66-4305-8bfe-45dde2354faf', '05b95378-31e5-4020-807b-04d9b89c292b', '9e59560e-07cb-4010-9db4-01e08b7a2a6f', 'defc6278-7bc8-46f9-a983-ce92624f663f', 'a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957', '409c4860-3410-423b-b6d1-e6ef10d36332', 'bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756', 'f37e842d-6cd4-418f-bbf9-d080ba3516d1', 'b73fffa1-5944-4b18-a4a3-4524859f2a56', '469659aa-55ee-4417-af33-cbcc618456d1', '1f5d56a6-c880-45fc-9906-c91296be3017', '368f5d0c-dc76-4d4f-b69c-1d60821659c2'} {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.062480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 797.086492] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.086492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.086492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.086492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.086492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.086492] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 797.086492] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.086848] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 797.165866] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.165995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.165995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.166226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.167200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.167428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 797.167508] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.167565] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 797.167627] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 797.167700] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 797.167768] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGH for action security_group_rules [ 797.167843] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGH for action security_group_rules [ 797.167904] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGH for action security_group_rules [ 797.167962] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGH for action security_group_rules [ 797.168031] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 797.168091] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGH for action security_group_rules [ 797.168148] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGH for action security_group_rules [ 797.168206] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGH for action security_group_rules [ 797.168262] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGH for action security_group_rules [ 797.168320] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGH for action security_group_rules [ 797.168378] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGH for action security_group_rules [ 797.168436] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGH for action security_group_rules [ 797.168494] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGH for action security_group_rules [ 797.168552] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGH for action security_group_rules [ 797.168610] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGH for action security_group_rules [ 797.168668] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGH for action security_group_rules [ 797.168727] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGH for action security_group_rules [ 797.168784] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGH for action security_group_rules [ 797.168841] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGH for action security_group_rules [ 797.168898] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGH for action security_group_rules [ 797.169603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.268591] env[65080]: INFO networking_nsxv3.common.synchronization [None req-43de0e60-9754-4a1d-806c-3c29c0f9152b None None] Enqueued Resource ID: d94d70af-1615-4509-a8cb-9c938fbcc4f4 with Priority: HIGHEST for action port [ 797.268858] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94d70af-1615-4509-a8cb-9c938fbcc4f4 with Priority: HIGHEST for action port [ 797.269070] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc6910c0-f6a2-426f-8968-cad99131eb9b with Priority: HIGH for action security_group_rules [ 797.269150] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGH for action security_group_rules [ 797.269232] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGH for action security_group_rules [ 797.269322] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 with Priority: HIGH for action security_group_rules [ 797.269419] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7235a15a-5182-42b0-892c-541ba160fba3 with Priority: HIGH for action security_group_rules [ 797.269501] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d with Priority: HIGH for action security_group_rules [ 797.269963] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aca6290-771b-45ff-a84d-6dbf408cedce with Priority: HIGH for action security_group_rules [ 797.269963] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27aecc9-ab87-4819-8111-15b950c38df6 with Priority: HIGH for action security_group_rules [ 797.269963] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a with Priority: HIGH for action security_group_rules [ 797.269963] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 with Priority: HIGH for action security_group_rules [ 797.270715] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGH for action security_group_rules [ 797.270715] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f49306d-9b39-4971-a2bc-404227491c8d with Priority: HIGH for action security_group_rules [ 797.270715] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b with Priority: HIGH for action security_group_rules [ 797.272231] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 with Priority: HIGH for action security_group_rules [ 797.272231] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec with Priority: HIGH for action security_group_rules [ 797.272231] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 with Priority: HIGH for action security_group_rules [ 797.272231] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGH for action security_group_rules [ 797.272579] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 797.272909] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf with Priority: HIGH for action security_group_rules [ 797.273062] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e with Priority: HIGH for action security_group_rules [ 797.277019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d94d70af-1615-4509-a8cb-9c938fbcc4f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d94d70af-1615-4509-a8cb-9c938fbcc4f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d94d70af-1615-4509-a8cb-9c938fbcc4f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d94d70af-1615-4509-a8cb-9c938fbcc4f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.277019] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94d70af-1615-4509-a8cb-9c938fbcc4f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.277019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc6910c0-f6a2-426f-8968-cad99131eb9b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.277019] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc6910c0-f6a2-426f-8968-cad99131eb9b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.277019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.277019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.277850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.277850] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.277850] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.277993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.278125] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.278217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.278342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.278425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.278469] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724930a7-3e32-4bbf-8611-b93b2ddfe0f4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.279238] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7235a15a-5182-42b0-892c-541ba160fba3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.279341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.279399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.279553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.279623] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7235a15a-5182-42b0-892c-541ba160fba3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.282064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.282064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.282064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.282064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.282064] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5205042a-83a4-497b-90f3-4c8bfbcc3a1d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.282926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2aca6290-771b-45ff-a84d-6dbf408cedce taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.283075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.283338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.287518] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2aca6290-771b-45ff-a84d-6dbf408cedce',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.287518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27aecc9-ab87-4819-8111-15b950c38df6 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.287518] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27aecc9-ab87-4819-8111-15b950c38df6',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.287518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.287518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.288265] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db21a227-1ffb-4e1a-8c5e-6d7e45c3755a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.288265] env[65080]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 797.289268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.289268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.289268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.289497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.289497] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dfe941e-e110-4be2-8d6d-f400f514d0e5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.292025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.292025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.292025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.292025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.292025] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.293415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f49306d-9b39-4971-a2bc-404227491c8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.293912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.294924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.294924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.294924] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f49306d-9b39-4971-a2bc-404227491c8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.297052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.298494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.298881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.299122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.299293] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5db4dff-67d7-4cc9-a39d-74b1615f620b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.300233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.301479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.301479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.301479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.301479] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdc4df4f-1494-4be5-9f4c-02d2b0808e83',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.301710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.301839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.301929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.302125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.302228] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b62ed3e-e617-4e8b-af7c-ff034e19bbec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.303072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc61faf-26f7-4161-a835-ebac2e25ee27 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.303218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.303339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.303490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.303593] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc61faf-26f7-4161-a835-ebac2e25ee27',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.304458] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.304599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.304726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.304932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.305060] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.306018] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.306370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.306370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.306370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.306521] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.307357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.307750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.307750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.307750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.307946] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4afef2a-fdec-49a9-a48d-5d83f81fd8bf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.308311] env[65080]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 797.308866] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.309204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.309204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.309314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.309352] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.487705] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.487870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.487968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.488309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.525633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.525926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.526045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.526300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.526300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.526385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.526479] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf is going to be updated. [ 797.528776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.528921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.528990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.529177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.529262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.529351] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b is going to be created. [ 797.584030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.584266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.584338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.584574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.584721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.587069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.587304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.587304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.587556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.587613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.603078] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: IN_PROGRESS for 2s [ 797.604044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: UNINITIALIZED for 2s [ 797.698190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 797.698190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.698190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.698190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.698190] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.777150] env[65080]: INFO networking_nsxv3.common.synchronization [None req-19352019-0ac7-486d-8768-8bda9ac6a684 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 797.777804] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 797.778371] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.778504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.778574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.778830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.778918] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.813149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.813425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.813425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.813567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.813726] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.813822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.813889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.814055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.814214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.814306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.814398] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.815499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d94d70af-1615-4509-a8cb-9c938fbcc4f4 [ 797.815748] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.815882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.815950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.816139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.816326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.816326] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d94d70af-1615-4509-a8cb-9c938fbcc4f4 already deleted. [ 797.816463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d94d70af-1615-4509-a8cb-9c938fbcc4f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.836510] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.836510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.837168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.837168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.839224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.839390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.861083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.861083] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc6910c0-f6a2-426f-8968-cad99131eb9b is going to be deleted. [ 797.861418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.861671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.882535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.882735] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724930a7-3e32-4bbf-8611-b93b2ddfe0f4 is going to be deleted. [ 797.886085] env[65080]: INFO networking_nsxv3.common.synchronization [None req-927fa1c0-b42b-488c-b52d-352cdc445781 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 797.886761] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 797.887062] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.887191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.939940] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.939940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.939940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.939940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.939940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.939940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc6910c0-f6a2-426f-8968-cad99131eb9b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.949015] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.949226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.949226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.949512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.949653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.949839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724930a7-3e32-4bbf-8611-b93b2ddfe0f4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.005622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.005622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.005622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.006192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.006192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.006192] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.013380] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.013380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.013380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.013714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.014022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.014022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.014022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.016234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.016384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.016492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.016590] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.038827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.038975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.039052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.039296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.039515] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.039675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.039734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.039863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.040329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.040329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.040329] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.057568] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.057795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.058033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.058367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.058570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.058922] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf is going to be deleted. [ 798.111381] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.111614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.111614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.112488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.116222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.116222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.125496] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.125851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.138169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.138261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.140822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.140964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.146741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.147572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.148959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.148959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.153590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.153590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.153590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.153590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.159665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.160750] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc61faf-26f7-4161-a835-ebac2e25ee27 is going to be deleted. [ 798.161317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.161610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.186484] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.186686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.187730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.187924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.189249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.189385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.196020] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 798.196975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.197155] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db21a227-1ffb-4e1a-8c5e-6d7e45c3755a is going to be deleted. [ 798.198296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.198532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.201840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.202036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.202113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.202328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.202504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.202603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.202666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.202811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.202898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.202984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.203093] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.224760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.225016] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2aca6290-771b-45ff-a84d-6dbf408cedce is going to be deleted. [ 798.227578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.227578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.265117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.266252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.280494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.280633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.283056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.283056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e is going to be deleted. [ 798.284139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.284345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.318946] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.318946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.319467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.319467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.319706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.319794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.319841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.320022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.320125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.320279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.320397] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.320470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.320525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.320674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.320817] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.320817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.320817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.320817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.320817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.321491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.321491] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.346354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.346651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.349949] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.350167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.364840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.365050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.377879] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 798.379101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.379101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7235a15a-5182-42b0-892c-541ba160fba3 is going to be deleted. [ 798.379672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.379910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.465032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.465355] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5205042a-83a4-497b-90f3-4c8bfbcc3a1d is going to be deleted. [ 798.467249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.467498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.500725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.500725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.531642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.531642] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dfe941e-e110-4be2-8d6d-f400f514d0e5 is going to be deleted. [ 798.533276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.533276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.534736] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.537861] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.547473] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.598225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.598399] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27aecc9-ab87-4819-8111-15b950c38df6 is going to be deleted. [ 798.599455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.599709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.603490] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.603656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.655897] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.656040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.663800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.663932] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f49306d-9b39-4971-a2bc-404227491c8d is going to be deleted. [ 798.665046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.665286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.707746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.707933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.708295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.708575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.708770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.709353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.709353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.709353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.709353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.709353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.709679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.709679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.709679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.709786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.709958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.710042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.710104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.710247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.710328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.710411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.710674] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.767509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.767650] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5db4dff-67d7-4cc9-a39d-74b1615f620b is going to be deleted. [ 798.768619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.768833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.824348] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 379c83f4-3ef4-4263-aff5-1c9a7750a19a: rpc.has_security_group_logging(os_id): False [ 798.826868] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.827606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.840270] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.840730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.870770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.870770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.870770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.870770] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdc4df4f-1494-4be5-9f4c-02d2b0808e83 is going to be deleted. [ 798.872517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.874789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.878775] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.878775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.947697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.947697] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b62ed3e-e617-4e8b-af7c-ff034e19bbec is going to be deleted. [ 798.949375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.950166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.950166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.950166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc61faf-26f7-4161-a835-ebac2e25ee27" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.950385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.950650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.950784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.950989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.951738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.952034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.953017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.953017] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c already deleted. [ 798.953017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.953017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.953017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.953249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.953294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db21a227-1ffb-4e1a-8c5e-6d7e45c3755a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.953493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.953754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.953892] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.955205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.955440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.955568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.955741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2aca6290-771b-45ff-a84d-6dbf408cedce" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.956418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.956418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.956541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.956601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b2c6eb5-7b1a-4e2e-93f4-fda1b5e4709e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.956761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.956991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.957242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.957365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7235a15a-5182-42b0-892c-541ba160fba3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.957499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.957639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5205042a-83a4-497b-90f3-4c8bfbcc3a1d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dfe941e-e110-4be2-8d6d-f400f514d0e5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27aecc9-ab87-4819-8111-15b950c38df6" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.959064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.959964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.995783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.995865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.996195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.996195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.996342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.996448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.996765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.996897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.996970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.997187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.997269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.997499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.997587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.997634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.997807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.997884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.997970] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 798.999272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.999483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.999593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.999690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f49306d-9b39-4971-a2bc-404227491c8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.018360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.018547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.018547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.018751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.018848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.019058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5db4dff-67d7-4cc9-a39d-74b1615f620b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.037556] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0bed36f-2ea1-4c82-9859-63ef0d32d194: rpc.has_security_group_logging(os_id): False [ 799.039392] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0ec527d-b1df-4719-9613-729c01dff53d: rpc.has_security_group_logging(os_id): False [ 799.050671] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a859d56-1200-4947-a281-afd910811864: rpc.has_security_group_logging(os_id): False [ 799.054452] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.054678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.054829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.055377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.055377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.055492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdc4df4f-1494-4be5-9f4c-02d2b0808e83" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.078899] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.079187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.079270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.079517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.106936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.107192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.107909] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.108062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.162470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.162701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.182253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.182634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.182746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.182815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.183054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.183151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.183301] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 is going to be updated. [ 799.185842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.188030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.213793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ab0447d-1533-4bb0-a280-31ec2fa0ff60: rpc.has_security_group_logging(os_id): False [ 799.235520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.235840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.235963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.236055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.236326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.236416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.236565] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be updated. [ 799.240107] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.240346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.240346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.241141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.242353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.242481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.296090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.297451] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.297451] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.297451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.297855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.297855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.297855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.297953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.297992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.298163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.298233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.298328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 799.299765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.299917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.300010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.300126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b62ed3e-e617-4e8b-af7c-ff034e19bbec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.300253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.300392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.357582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.358616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.358616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.358616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.358905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.358905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.358905] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 799.361204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.361612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.363020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.364963] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.365225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.365351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.365690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.365961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.389562] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: IN_PROGRESS for 2s [ 799.410473] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 799.506501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.506709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.506781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.507015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.507115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.507218] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c already deleted. [ 799.507298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.571149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.571376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.571455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.571741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.571854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.574557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.574557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.574557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.574930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.574930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.583531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.583703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.583703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.584063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.584063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.594196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: IN_PROGRESS for 2s [ 799.603662] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 799.605354] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 799.615369] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: SUCCESS [ 799.615562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.615666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.615877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.616099] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.616240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.616317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.617010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.617170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.617271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.617368] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.619572] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 799.619992] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf in Status: SUCCESS [ 799.620217] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4afef2a-fdec-49a9-a48d-5d83f81fd8bf deletion is rescheduled due to dependency. [ 799.620315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4afef2a-fdec-49a9-a48d-5d83f81fd8bf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.119781] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.120362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.120569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.120961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.121094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.121172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.121470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.121643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.121643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.121827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.122047] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.122222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.122365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.122422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.122538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.122667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.122735] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.627435] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c05ac33-707c-472e-b683-3c9cbb9a919b: rpc.has_security_group_logging(os_id): False [ 800.649097] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.649293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.649355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.649625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.649809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.650020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.650180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.650339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.650561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.650678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.650974] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.651111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.651171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.651339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.651427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.651641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.651758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.651846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.652028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.652097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.652188] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b is going to be created. [ 800.714758] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.714891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.714965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.715299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.715548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.730611] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: IN_PROGRESS for 2s [ 801.402814] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: SUCCESS [ 801.403081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.475214] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 801.475455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.607194] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: SUCCESS [ 801.607333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.619764] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 801.619977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.620739] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 801.620889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.747085] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: SUCCESS [ 802.747390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.888234] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 802.888346] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 807.315507] env[65080]: INFO networking_nsxv3.common.synchronization [req-32318a99-14d5-4dff-b494-72b42c282c8c req-ec55faf0-17f9-4794-b715-789dda6edc87 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 807.316060] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 807.316374] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.316498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.316564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.316948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.317242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.317242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.317421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.317472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.317578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.317623] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.635226] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.635226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-170" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.635226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-170" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.635226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-170" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.635637] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.635882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.636027] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.636455] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.636650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.636903] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.637062] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.637463] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.637654] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.637774] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.637876] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.638050] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.662113] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.662290] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.662782] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.662782] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-170" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.662928] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-77862447-9c31-42ac-ace0-4a94fb359564 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.663077] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.663195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.663542] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.663799] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77862447-9c31-42ac-ace0-4a94fb359564',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.822059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.822352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.822471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.822800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.822923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.823148] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.823253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.823318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.823482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.823556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.823644] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 already deleted. [ 807.823724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.912845] env[65080]: INFO networking_nsxv3.common.synchronization [req-abfe95c5-4f70-479b-92c3-0e4079d5fce4 req-c4eebca2-4e40-4ca5-a765-1d8a0c5605ad tempest-ServerPasswordTestJSON-1244565361 tempest-ServerPasswordTestJSON-1244565361-project-member] Enqueued Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 807.913383] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGHEST for action security_group_members [ 807.913696] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.913812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.913889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.914098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.914281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.914419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.914462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.914604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.914685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.914778] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.168706] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.168951] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.169089] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.169392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.169531] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.169689] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 77862447-9c31-42ac-ace0-4a94fb359564 not found, creating... [ 808.169947] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.170121] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.170234] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.170455] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.170591] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.170871] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.171032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.171148] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.171349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.171479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.171613] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 77862447-9c31-42ac-ace0-4a94fb359564 is going to be created. [ 808.195319] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.195544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.195654] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.195921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.196166] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.196401] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.417020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.417466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.417466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.417466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.417674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.417736] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.417821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.417884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.418801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.418801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.418801] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b is going to be updated. [ 808.444898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.445050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.445102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.446026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.446026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.455965] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: IN_PROGRESS for 2s [ 808.885423] env[65080]: INFO networking_nsxv3.common.synchronization [req-32318a99-14d5-4dff-b494-72b42c282c8c req-fa5f387a-e6c0-4aae-91d2-129faf5c6bd2 service nova] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 808.885423] env[65080]: INFO networking_nsxv3.common.synchronization [req-32318a99-14d5-4dff-b494-72b42c282c8c req-fa5f387a-e6c0-4aae-91d2-129faf5c6bd2 service nova] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 808.885548] env[65080]: INFO networking_nsxv3.common.synchronization [req-32318a99-14d5-4dff-b494-72b42c282c8c req-fa5f387a-e6c0-4aae-91d2-129faf5c6bd2 service nova] Enqueued Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 808.886063] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 808.886216] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 808.886315] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 808.886594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.886722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.886863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.887259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.887386] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.889701] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.889701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.889701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.889701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.889912] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.891023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.891023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.891023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.891023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.891023] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.892976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-77862447-9c31-42ac-ace0-4a94fb359564 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.892976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.892976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.892976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.892976] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77862447-9c31-42ac-ace0-4a94fb359564',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.390294] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.390433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.392856] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.398029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77862447-9c31-42ac-ace0-4a94fb359564 with status ACTIVE [ 809.398029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.398029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.398029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.398029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.398029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77862447-9c31-42ac-ace0-4a94fb359564 is going to be updated. [ 809.418453] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.418724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.418724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.418877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.419017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.419179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.899229] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.403686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.403820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.403902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.404122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.404275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.404877] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be created. [ 810.436444] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.436870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.436870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.437029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.437126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.448653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: UNINITIALIZED for 2s [ 810.465404] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b in Status: SUCCESS [ 810.465587] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b deletion is rescheduled due to dependency. [ 810.465701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.872745] env[65080]: INFO networking_nsxv3.common.synchronization [req-6ff2c9cf-d618-442a-938b-8c2e242aee1f req-b064e014-1a86-4d11-adca-b3b43eb7454c tempest-ServersV294TestFqdnHostnames-1569834486 tempest-ServersV294TestFqdnHostnames-1569834486-project-member] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 810.873375] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 810.873720] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.873975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.873975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.874450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.874634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.874787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.875289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.875289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.875289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.875467] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.247256] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.247433] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-566" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.247484] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-566" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.247811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-566" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.248262] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.248262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.248458] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.248625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.248769] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.248971] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.249142] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.249281] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.249356] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.249467] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.249567] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.249693] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.269342] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.269566] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.269714] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.269893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-566" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.270227] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-82bf0b83-7dee-407e-853b-4d186e08f171 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.270403] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.270529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.270854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.270991] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82bf0b83-7dee-407e-853b-4d186e08f171',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.379406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.379569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.379635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.379854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.379946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.380162] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.380267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.380331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.380479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.380556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.380640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 already deleted. [ 811.380721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.774305] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.774647] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.774697] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.774968] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.775209] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.775479] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 82bf0b83-7dee-407e-853b-4d186e08f171 not found, creating... [ 811.775785] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.775989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.776070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.776726] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.776875] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.777102] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.777198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.777327] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.777459] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 82bf0b83-7dee-407e-853b-4d186e08f171 is going to be created. [ 811.801063] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.801330] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.801409] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.801802] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.801928] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.802390] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.460902] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 812.460902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.460902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.461416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.461416] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.461563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.461563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.461641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.461722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.461802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.461914] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.601925] env[65080]: INFO networking_nsxv3.common.synchronization [req-6ff2c9cf-d618-442a-938b-8c2e242aee1f req-3cf38333-e156-495f-af3d-2672efc25625 service nova] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 812.602178] env[65080]: INFO networking_nsxv3.common.synchronization [req-6ff2c9cf-d618-442a-938b-8c2e242aee1f req-3cf38333-e156-495f-af3d-2672efc25625 service nova] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 812.602368] env[65080]: INFO networking_nsxv3.common.synchronization [req-6ff2c9cf-d618-442a-938b-8c2e242aee1f req-3cf38333-e156-495f-af3d-2672efc25625 service nova] Enqueued Resource ID: 82bf0b83-7dee-407e-853b-4d186e08f171 with Priority: HIGHEST for action port [ 812.602952] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_rules [ 812.603239] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 812.603301] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82bf0b83-7dee-407e-853b-4d186e08f171 with Priority: HIGHEST for action port [ 812.603576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.603734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.604584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.604835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.604957] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.606327] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.606425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.606462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.606857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.607017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.607171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.607308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.607492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.607581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.607863] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.608701] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-82bf0b83-7dee-407e-853b-4d186e08f171 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.608797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.608836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.609049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.609133] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82bf0b83-7dee-407e-853b-4d186e08f171',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.964897] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.966278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.966278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.966278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.966278] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.966278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.966278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.966674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.966674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.966674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.966782] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.966855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.966916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.967063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.967205] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.967283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.967335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.967472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.967566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.967625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.968023] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.110601] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.111804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.111949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.112382] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82bf0b83-7dee-407e-853b-4d186e08f171 with status ACTIVE [ 813.112465] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.112567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.112643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.113204] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.113806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.114156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.114310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.114414] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82bf0b83-7dee-407e-853b-4d186e08f171 is going to be updated. [ 813.139114] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.139335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.139435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.139669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.139882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.140342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82bf0b83-7dee-407e-853b-4d186e08f171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.473154] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ff651ba-db91-4903-b7c9-61210ba27bf2: rpc.has_security_group_logging(os_id): False [ 813.488937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.490117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.490117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.490534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.490534] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.490534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.490534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.490675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.490797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.491017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.491187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.491269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.491466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.491578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.491668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be created. [ 813.554852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.554852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.554852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.554852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.554852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.565531] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 813.612740] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.617869] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3672f65-ebd2-4560-b658-c8e66ce15d14 req-9f2bcfe3-e427-4b3d-b848-15e1aa3d20ca tempest-ServersTestJSON-694710217 tempest-ServersTestJSON-694710217-project-member] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 813.618548] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 813.619253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.619382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.619497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.619690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.619848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.619951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.620033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.620192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.620280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.620378] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.001114] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.001657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-520" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.001657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-520" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.002586] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-520" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.002901] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.003532] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.003737] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.004400] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.004579] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.004817] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.004966] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.005485] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.005606] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.005772] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.005888] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.006623] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.034833] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.035504] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.035504] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.035707] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-520" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.036241] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9b37a5f6-a430-4af1-8409-2291011af58f taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.036564] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.036797] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.037318] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.037582] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b37a5f6-a430-4af1-8409-2291011af58f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.114877] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.115187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.115290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.115497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.115626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.115780] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 is going to be created. [ 814.123653] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.123912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.123984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.124575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.124824] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.124936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.125012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.125217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.125341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.125448] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 already deleted. [ 814.125507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.150299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.150459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.150518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.150799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.151012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.167628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: UNINITIALIZED for 2s [ 814.541407] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.541644] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.541771] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.542088] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.542274] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.542437] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9b37a5f6-a430-4af1-8409-2291011af58f not found, creating... [ 814.542710] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.542862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.542980] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.543253] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.543359] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.543648] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.543802] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.543906] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.544132] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.544284] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.544462] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9b37a5f6-a430-4af1-8409-2291011af58f is going to be created. [ 814.570898] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.570898] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.571646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.571819] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.572127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.572416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.343694] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3672f65-ebd2-4560-b658-c8e66ce15d14 req-d1a8d5d2-86c3-4e29-8b63-f6b6380c1415 service nova] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 815.343988] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3672f65-ebd2-4560-b658-c8e66ce15d14 req-d1a8d5d2-86c3-4e29-8b63-f6b6380c1415 service nova] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 815.344134] env[65080]: INFO networking_nsxv3.common.synchronization [req-e3672f65-ebd2-4560-b658-c8e66ce15d14 req-d1a8d5d2-86c3-4e29-8b63-f6b6380c1415 service nova] Enqueued Resource ID: 9b37a5f6-a430-4af1-8409-2291011af58f with Priority: HIGHEST for action port [ 815.344842] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_rules [ 815.345388] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 815.345570] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b37a5f6-a430-4af1-8409-2291011af58f with Priority: HIGHEST for action port [ 815.345930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.346113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.346926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.346926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.346926] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.349099] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.349099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.349099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.349457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.349694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.349855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.350039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.350259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.351245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.351245] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.352258] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b37a5f6-a430-4af1-8409-2291011af58f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.352477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.352608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.352865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.353044] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b37a5f6-a430-4af1-8409-2291011af58f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.579351] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 815.579351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.849392] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.849598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.859499] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.860516] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b37a5f6-a430-4af1-8409-2291011af58f with status ACTIVE [ 815.860730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.860886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.860956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.861218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.861316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.861508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.861609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.861680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.861826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.861941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.862101] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.862209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.862267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.862413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.862489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.862573] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b37a5f6-a430-4af1-8409-2291011af58f is going to be updated. [ 815.885264] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.885418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.885512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.885773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.885942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.886146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b37a5f6-a430-4af1-8409-2291011af58f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.177098] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: SUCCESS [ 816.180492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.180694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.180923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.181177] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.181314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.181383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.181552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.181634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.181719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.181808] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.365032] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.684409] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.870596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.870807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.870807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.871055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.871154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.871259] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 is going to be created. [ 816.903843] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.904075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.904153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.904551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.905234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.919117] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: UNINITIALIZED for 2s [ 817.187595] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f26b803-17d9-4a38-b02c-de9324967417: rpc.has_security_group_logging(os_id): False [ 817.209810] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.209810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.209810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.210173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.210173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.210341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.210440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.210552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.211087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.211087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.211087] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 is going to be created. [ 817.285402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.285402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.285402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.286029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.286258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.310260] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: IN_PROGRESS for 2s [ 817.463706] env[65080]: INFO networking_nsxv3.common.synchronization [req-16fab476-eef1-4e50-a3c5-7bf30b7c186d req-84e7b295-f61c-4ca0-af18-8ff0da6f1c70 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 817.463706] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 817.463706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.463706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.463706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.464390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.464390] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.464390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.464390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.464390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.464643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.464643] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.886145] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.886502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.886502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.886716] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.886971] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.887145] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.887259] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.887471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.887612] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.887815] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.887924] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.888040] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.888147] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.888267] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.888373] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.888506] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.917609] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.917817] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.917967] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.918262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.918668] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-e90cddae-f697-4c3f-b445-7ee532007af9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.918975] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.919076] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.919388] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.919530] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90cddae-f697-4c3f-b445-7ee532007af9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.966867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.967319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.967319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.967594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.991092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.991362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.991483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.991548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.991756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.991962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.991962] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 818.021162] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.021314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.021552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.021672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.021882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.036199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 818.422290] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.422633] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.422746] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.423070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.423269] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.423457] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port e90cddae-f697-4c3f-b445-7ee532007af9 not found, creating... [ 818.423861] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.424109] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.424252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.424501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.424643] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.425068] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.425297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.425446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.425669] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.425892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.426141] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: e90cddae-f697-4c3f-b445-7ee532007af9 is going to be created. [ 818.449025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.449296] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.449495] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.449773] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.449995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.450239] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.932223] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: SUCCESS [ 818.932223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.932223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.932572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.932572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.932749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.932749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.932860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.932860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.932956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.933095] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.197208] env[65080]: INFO networking_nsxv3.common.synchronization [req-16fab476-eef1-4e50-a3c5-7bf30b7c186d req-ecad75d3-6fac-4757-93ef-0d49d8539d10 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 819.197429] env[65080]: INFO networking_nsxv3.common.synchronization [req-16fab476-eef1-4e50-a3c5-7bf30b7c186d req-ecad75d3-6fac-4757-93ef-0d49d8539d10 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 819.197607] env[65080]: INFO networking_nsxv3.common.synchronization [req-16fab476-eef1-4e50-a3c5-7bf30b7c186d req-ecad75d3-6fac-4757-93ef-0d49d8539d10 service nova] Enqueued Resource ID: e90cddae-f697-4c3f-b445-7ee532007af9 with Priority: HIGHEST for action port [ 819.198212] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 819.198474] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 819.198474] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90cddae-f697-4c3f-b445-7ee532007af9 with Priority: HIGHEST for action port [ 819.198715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.198931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.199038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.199234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.199316] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.200272] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.200388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.200562] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90cddae-f697-4c3f-b445-7ee532007af9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.200690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.200747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.200978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.201086] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90cddae-f697-4c3f-b445-7ee532007af9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.324996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: SUCCESS [ 819.325287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.436994] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.703557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.703756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.703827] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e90cddae-f697-4c3f-b445-7ee532007af9 with status ACTIVE [ 819.704150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.704373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.704717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.704717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.704895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.705023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.705144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.705233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.705387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.705545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.705753] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.705874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.705944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.706105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.706203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.706293] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e90cddae-f697-4c3f-b445-7ee532007af9 is going to be updated. [ 819.729282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.729481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.729615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.729894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.730117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.730349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90cddae-f697-4c3f-b445-7ee532007af9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.939213] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00: rpc.has_security_group_logging(os_id): False [ 819.958914] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.959113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.959158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.959644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.959644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.959788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.959913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.959968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.960147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.960240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.960313] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 is going to be created. [ 820.028303] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.028488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.028587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.029085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.029085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.041489] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: IN_PROGRESS for 2s [ 820.048345] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 820.048530] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 820.048644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.049241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.049969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.050696] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.050949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.050949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.051310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.051364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.051469] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.172692] env[65080]: INFO networking_nsxv3.common.synchronization [req-55baa786-5c8a-4216-8b21-4a6c24b957fb req-ec60d28a-fb94-4500-95b1-a657c266adb9 tempest-FloatingIPsAssociationNegativeTestJSON-339216273 tempest-FloatingIPsAssociationNegativeTestJSON-339216273-project-member] Enqueued Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 820.174171] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 820.174572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.174956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.174956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.175077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.175542] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.175542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.175542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.175699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.175731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.175868] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.555345] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.635634] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.638923] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.638923] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.638923] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.638923] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.638923] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.638923] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.639628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.639929] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.640282] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.640445] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.640594] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.640886] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.641099] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.641287] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.641522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.671090] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.671409] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.671635] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.671909] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.672371] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c5a85f94-2e8e-4b45-8040-b68268fc6f05 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.672610] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.672821] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.675820] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.675820] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a85f94-2e8e-4b45-8040-b68268fc6f05',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.679466] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.679466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.679466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.679466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.680141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.680141] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.680141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.680141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.680141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.680467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.680467] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 already deleted. [ 820.680467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.060792] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.179026] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.179026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.179026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.179288] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.179439] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.179596] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c5a85f94-2e8e-4b45-8040-b68268fc6f05 not found, creating... [ 821.179850] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.180011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.180133] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.180346] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.180484] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.180750] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.180912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.181060] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.181267] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.181401] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.181538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c5a85f94-2e8e-4b45-8040-b68268fc6f05 is going to be created. [ 821.204907] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.205015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.205124] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.205408] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.205733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.205886] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.567233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.567409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.567455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.567676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.567866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.567866] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 821.602956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.603219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.603275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.603557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.604659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.614439] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 821.912938] env[65080]: INFO networking_nsxv3.common.synchronization [req-55baa786-5c8a-4216-8b21-4a6c24b957fb req-e0dc28bd-e382-4a52-9a93-620f9b957403 service nova] Enqueued Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_rules [ 821.913131] env[65080]: INFO networking_nsxv3.common.synchronization [req-55baa786-5c8a-4216-8b21-4a6c24b957fb req-e0dc28bd-e382-4a52-9a93-620f9b957403 service nova] Enqueued Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 821.913269] env[65080]: INFO networking_nsxv3.common.synchronization [req-55baa786-5c8a-4216-8b21-4a6c24b957fb req-e0dc28bd-e382-4a52-9a93-620f9b957403 service nova] Enqueued Resource ID: c5a85f94-2e8e-4b45-8040-b68268fc6f05 with Priority: HIGHEST for action port [ 821.913793] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_rules [ 821.913930] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 821.914064] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a85f94-2e8e-4b45-8040-b68268fc6f05 with Priority: HIGHEST for action port [ 821.914401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.914540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.914624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.914889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.914968] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.915891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.915991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.916089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.916248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.916399] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.916521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.916601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.916755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.916842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.916940] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.919176] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a85f94-2e8e-4b45-8040-b68268fc6f05 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.919176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.919176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.919303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.919303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a85f94-2e8e-4b45-8040-b68268fc6f05',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.056990] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: SUCCESS [ 822.057392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.422324] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.422324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.422727] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.423858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a85f94-2e8e-4b45-8040-b68268fc6f05 with status ACTIVE [ 822.423858] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.423858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.423858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.424064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.424064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.425085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.425085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.425085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.425085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.425085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.425085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.425447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.425447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.425447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.425542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.425730] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a85f94-2e8e-4b45-8040-b68268fc6f05 is going to be updated. [ 822.447403] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.447563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.447604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.447818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.447952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.448126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a85f94-2e8e-4b45-8040-b68268fc6f05" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.867028] env[65080]: INFO networking_nsxv3.common.synchronization [req-aa8aa608-baff-446c-a2b6-c87bd5ae5740 req-12ca3402-f70a-4215-8383-5ed3dc3e2ff3 tempest-ServersTestBootFromVolume-713779798 tempest-ServersTestBootFromVolume-713779798-project-member] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 822.867135] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 822.867473] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.867600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.867668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.867935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.868110] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.868224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.868320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.868398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.868481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.868575] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.928477] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.283322] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.283488] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-260" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.283646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-260" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.284071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-260" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.284706] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.284905] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.285045] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.285308] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.285455] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.285687] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.285800] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.285907] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.286031] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.286191] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.286240] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.286566] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.306235] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.306431] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.306621] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.306852] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-260" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.307196] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-5d56c30c-031f-4654-8eb4-37bfc06936b9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.307429] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.307598] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.307963] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.308123] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d56c30c-031f-4654-8eb4-37bfc06936b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.373041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.373041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.373041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 already deleted. [ 823.373041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.432084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.432084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.432084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.432084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.432084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.432084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 is going to be created. [ 823.461785] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.461971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.462040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.462304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.462765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.474403] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: UNINITIALIZED for 2s [ 823.629306] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.629306] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.629306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.629306] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.811128] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.811392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.811523] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.811842] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.812035] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.812219] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 5d56c30c-031f-4654-8eb4-37bfc06936b9 not found, creating... [ 823.812498] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.812697] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.812816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.813080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.813226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.813543] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.813770] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.813917] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.814183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.814381] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.814526] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 5d56c30c-031f-4654-8eb4-37bfc06936b9 is going to be created. [ 823.836733] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.837011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.837222] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.837533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.838039] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.838328] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.132892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.133120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.133234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.133483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.133701] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.133826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.133875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.134089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.134159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.134299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.134451] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.134547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.134605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.134752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.134914] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.135262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.135262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.135262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.135397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.135448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.135549] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.607863] env[65080]: INFO networking_nsxv3.common.synchronization [req-aa8aa608-baff-446c-a2b6-c87bd5ae5740 req-2514b1e7-dcde-4b2e-880e-49e6ba6fe992 service nova] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 824.608569] env[65080]: INFO networking_nsxv3.common.synchronization [req-aa8aa608-baff-446c-a2b6-c87bd5ae5740 req-2514b1e7-dcde-4b2e-880e-49e6ba6fe992 service nova] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 824.608864] env[65080]: INFO networking_nsxv3.common.synchronization [req-aa8aa608-baff-446c-a2b6-c87bd5ae5740 req-2514b1e7-dcde-4b2e-880e-49e6ba6fe992 service nova] Enqueued Resource ID: 5d56c30c-031f-4654-8eb4-37bfc06936b9 with Priority: HIGHEST for action port [ 824.609741] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_rules [ 824.610111] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 824.610395] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d56c30c-031f-4654-8eb4-37bfc06936b9 with Priority: HIGHEST for action port [ 824.613180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.613180] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.613180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.613180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.613180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.614174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.617395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.617395] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.617395] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d56c30c-031f-4654-8eb4-37bfc06936b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.617395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.617395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.617395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.617395] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d56c30c-031f-4654-8eb4-37bfc06936b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.640521] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354ecbf4-79a8-4770-9da4-7284d1f205e7: rpc.has_security_group_logging(os_id): False [ 824.661815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.663086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.663086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.663086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.663086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.663086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.664686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.664686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.664686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.665581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.665581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.665581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.665581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.665581] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 824.739166] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.739166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.739166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.739487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.739487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.754646] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 825.117661] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.117892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.118065] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.119334] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d56c30c-031f-4654-8eb4-37bfc06936b9 with status ACTIVE [ 825.119581] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.119758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.119885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.120291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.120407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.120666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.120792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.120871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.121112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.121291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.121536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.121795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.122076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.122228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.122382] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d56c30c-031f-4654-8eb4-37bfc06936b9 is going to be updated. [ 825.150672] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.150672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.150672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.150672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.150672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.150672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d56c30c-031f-4654-8eb4-37bfc06936b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.162827] env[65080]: INFO networking_nsxv3.common.synchronization [req-4d9187a1-9464-4a78-a896-0659d3a32e21 req-2913b51a-0845-4411-94b6-5a4066ce20a1 tempest-ListServerFiltersTestJSON-1776702500 tempest-ListServerFiltersTestJSON-1776702500-project-member] Enqueued Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 825.164813] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 with Priority: HIGHEST for action security_group_members [ 825.165321] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-368f5d0c-dc76-4d4f-b69c-1d60821659c2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.165523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.165630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.165953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.166213] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.166397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.167948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.168663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.169740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.169740] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('368f5d0c-dc76-4d4f-b69c-1d60821659c2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.486288] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: SUCCESS [ 825.486288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.486587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.486980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.487291] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.487463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.487570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.491028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.491028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.491028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.491028] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.625237] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.673248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.673416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.674413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.674413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.697700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.697972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.698125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.698203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.698401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.698509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.698591] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 is going to be updated. [ 825.726873] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-254baf78-5660-4103-8ea6-5a581167eda5 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 825.728364] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.728568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.728681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.728968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.729155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.730668] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 825.731097] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.731290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.731671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.731834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.732142] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.732422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.732848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.732848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.732848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.733055] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.743469] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: IN_PROGRESS for 2s [ 825.992010] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.992653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.992775] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.993096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.993180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.993269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.993436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.993510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.993560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.993695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.993835] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.993930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.993984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.994198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.994376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.994376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.994505] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.127785] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.127785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.128239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.128239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.128239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.128464] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 is going to be created. [ 826.157697] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.157914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.158017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.158259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.158488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.170587] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: UNINITIALIZED for 2s [ 826.212814] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-fd1315bc-d0d7-49aa-bed2-79a339f8d813 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 826.213449] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 826.213909] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.214049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.237116] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.237621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.238094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.238555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.238773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.239102] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.239325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.240327] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 already deleted. [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.240327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.240654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.240654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.240654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.240654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.240803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.240803] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.499551] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69af222b-9d8b-4146-9ffa-942af2d8c839: rpc.has_security_group_logging(os_id): False [ 826.522780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.522913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.522999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.523289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.523386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.523612] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.524071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.524071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.524071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.524071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.524243] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.524330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.524368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.524518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.524599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.524784] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.524879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.524940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.525577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.525702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.525829] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 is going to be created. [ 826.596148] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.596338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.596425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.596644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.596824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.611520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: IN_PROGRESS for 2s [ 826.638803] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-3ff59e11-a982-4dcf-9f1d-e6fa21fb26c1 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 826.639545] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 826.639832] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.639952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.745703] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.746071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.746753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.747081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.747266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.747655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.748954] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 already deleted. [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.748954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.750058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.750058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.750058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.750058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.751314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.751314] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.786271] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 826.786933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.059796] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.060091] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.060311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.060638] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.060989] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.061242] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.061411] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.061724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.061963] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.062224] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.062413] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.062557] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.062738] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.062816] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.062930] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.063126] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.084283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.084530] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.084734] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.084973] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.085417] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-6556ff09-e8e2-42db-b170-103151b571e2 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.085627] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.085812] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.086241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.086419] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6556ff09-e8e2-42db-b170-103151b571e2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.253611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.253806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.253891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.254186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.254281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.254636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.254789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.254849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.255094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.255183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.255326] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 already deleted. [ 827.255437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.591189] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.591514] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.591684] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.592122] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.592303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.592513] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 6556ff09-e8e2-42db-b170-103151b571e2 not found, creating... [ 827.592825] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.593070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.593902] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.593902] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.593902] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.594119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.594283] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.594445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.594716] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.594860] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.595016] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 6556ff09-e8e2-42db-b170-103151b571e2 is going to be created. [ 827.627321] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.627620] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.627763] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.628120] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.628414] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.628724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.781224] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 in Status: SUCCESS [ 827.781224] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 368f5d0c-dc76-4d4f-b69c-1d60821659c2 deletion is rescheduled due to dependency. [ 827.781224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-368f5d0c-dc76-4d4f-b69c-1d60821659c2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.182505] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: SUCCESS [ 828.183117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.183370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.183633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.183906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.184030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.184109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.184319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.184441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.184495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.184556] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.425801] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a742af4-5592-418d-9ce8-0ca71834a044 req-37c5535d-f4bf-43c9-8f75-0dae98e175bc tempest-ServerAddressesNegativeTestJSON-147507694 tempest-ServerAddressesNegativeTestJSON-147507694-project-member] Enqueued Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 828.426455] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 828.428110] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.428247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.428316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.428578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.428745] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.428848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.428912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.429075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.429163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.429259] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.430963] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-6575e61b-4a5e-4ddf-b163-db30e5076db8 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 828.431569] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-6575e61b-4a5e-4ddf-b163-db30e5076db8 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 828.431740] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-6575e61b-4a5e-4ddf-b163-db30e5076db8 service nova] Enqueued Resource ID: 6556ff09-e8e2-42db-b170-103151b571e2 with Priority: HIGHEST for action port [ 828.433423] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 828.433423] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 828.433423] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6556ff09-e8e2-42db-b170-103151b571e2 with Priority: HIGHEST for action port [ 828.433423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.433706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.433706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.434531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.434531] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.435973] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.435973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.435973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.435973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.435973] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.435973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.435973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.437828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.437828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.437828] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.437828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6556ff09-e8e2-42db-b170-103151b571e2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.437828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.437828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.437828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.437828] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6556ff09-e8e2-42db-b170-103151b571e2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.633341] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: SUCCESS [ 828.633707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.689876] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.934769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.935245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.935245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.935245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.935425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.935508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.935629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.935784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.936018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.936102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.936191] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e already deleted. [ 828.936274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.938718] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.940177] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.940354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.940579] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6556ff09-e8e2-42db-b170-103151b571e2 with status ACTIVE [ 828.940837] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.941037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.941179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.941467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.941639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.941945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.942128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.942245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.942544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.942684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.942968] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.943169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.943278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.943497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.943929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.943929] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6556ff09-e8e2-42db-b170-103151b571e2 is going to be updated. [ 828.969654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.969654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.969654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.969945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.969945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.970183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6556ff09-e8e2-42db-b170-103151b571e2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.092682] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.092896] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-683" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.093504] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-683" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.094451] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-683" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.095057] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.096023] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.096239] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.096879] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.096879] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.096879] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.097084] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.097132] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.097736] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.097736] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.097736] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.097736] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.120472] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.120674] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.120966] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.121044] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-683" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.121355] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.121555] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.121675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.122066] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.122218] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00999ac-3d7b-4f32-9e88-f70f9c151c3e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.193272] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2314d2a9-c4bd-47c8-8042-e43fbe76d252: rpc.has_security_group_logging(os_id): False [ 829.215255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.215538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.215538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.215657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.215851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.216257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.216356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.216581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.216913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216913] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 is going to be created. [ 829.300157] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.300157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.300157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.300157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.300157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.317558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: IN_PROGRESS for 2s [ 829.446351] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.625096] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.626265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.626265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.626265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.626265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.626265] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port b00999ac-3d7b-4f32-9e88-f70f9c151c3e not found, creating... [ 829.626874] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.626874] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.627021] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.627287] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.628097] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.628097] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.628097] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.628420] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.628420] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.628530] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.628718] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: b00999ac-3d7b-4f32-9e88-f70f9c151c3e is going to be created. [ 829.651435] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.651895] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.651895] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.652158] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.652395] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.653357] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.741057] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.741436] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-258" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.741595] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-258" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.742168] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-258" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.742551] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.742779] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.742927] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.743189] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.743338] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.743551] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.743677] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.743786] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.743868] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.743977] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.744094] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.744273] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.766896] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.767111] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.767254] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.767471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-258" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.767822] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.767995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.768123] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.768427] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.768558] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59c12079-2bf6-4ff9-804d-dcffc6dd7d4e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.948808] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.949138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.949138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.949351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.949474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.949602] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be created. [ 829.977301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.977555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.977694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.977995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.978252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.989458] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: UNINITIALIZED for 2s [ 830.273547] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.273822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.273964] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.274277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.274503] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.274679] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e not found, creating... [ 830.275026] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.275214] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.275353] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.275630] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.275777] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.276129] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.276308] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.276424] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.276636] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.276792] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.276931] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e is going to be created. [ 830.302405] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.302709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.302844] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.303191] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.303446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.303673] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.386700] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a742af4-5592-418d-9ce8-0ca71834a044 req-c0bc708b-dc33-4b1f-82c7-4bc3e5e0e806 service nova] Enqueued Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_rules [ 830.386896] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a742af4-5592-418d-9ce8-0ca71834a044 req-c0bc708b-dc33-4b1f-82c7-4bc3e5e0e806 service nova] Enqueued Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 830.387081] env[65080]: INFO networking_nsxv3.common.synchronization [req-1a742af4-5592-418d-9ce8-0ca71834a044 req-c0bc708b-dc33-4b1f-82c7-4bc3e5e0e806 service nova] Enqueued Resource ID: b00999ac-3d7b-4f32-9e88-f70f9c151c3e with Priority: HIGHEST for action port [ 830.387622] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_rules [ 830.387825] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 830.387950] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00999ac-3d7b-4f32-9e88-f70f9c151c3e with Priority: HIGHEST for action port [ 830.388569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.388699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.390593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.390593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.390593] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.393105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.393309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.393401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.393645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.393849] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.393955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.394035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.394225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.394426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.394536] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.396027] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.396180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.396245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.396426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.396426] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00999ac-3d7b-4f32-9e88-f70f9c151c3e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.900875] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.900875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.901303] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b00999ac-3d7b-4f32-9e88-f70f9c151c3e with status ACTIVE [ 830.901557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.901557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.901651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.901879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.901970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.902190] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.902300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.902828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.902828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.902828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.902828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.903020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.903020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.903169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.903232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.903321] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b00999ac-3d7b-4f32-9e88-f70f9c151c3e is going to be updated. [ 830.906671] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.931545] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.931545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.931545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.931545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.931545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.931545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00999ac-3d7b-4f32-9e88-f70f9c151c3e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.050975] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-bab84766-e393-4703-bd4e-fa7dfc5f7ca4 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 831.051694] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-bab84766-e393-4703-bd4e-fa7dfc5f7ca4 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 831.051694] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-bab84766-e393-4703-bd4e-fa7dfc5f7ca4 service nova] Enqueued Resource ID: 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e with Priority: HIGHEST for action port [ 831.053084] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 831.053294] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 831.053501] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e with Priority: HIGHEST for action port [ 831.054240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.055230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.057938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.057938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.057938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.057938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.059228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.059511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.059636] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59c12079-2bf6-4ff9-804d-dcffc6dd7d4e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.334803] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: SUCCESS [ 831.335070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.416086] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.564106] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e with status ACTIVE [ 831.565040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.565245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.565358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.565696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.565901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.566330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.566502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.566716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.566896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.567099] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.567280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.567350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.567565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.567702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.567823] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59c12079-2bf6-4ff9-804d-dcffc6dd7d4e is going to be updated. [ 831.596731] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.596922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.596984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.597170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.597309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.597486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59c12079-2bf6-4ff9-804d-dcffc6dd7d4e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.851452] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.851452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.851452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.851452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.851830] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.852049] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.852227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.852612] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.852749] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.853328] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.853328] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.853451] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.853558] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.853723] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.853885] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.854624] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.875405] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.875405] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.875405] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.875606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-923" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.875881] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-f2b2d848-23a9-4e59-99fe-f5621d3e6144 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.876105] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.876242] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.876555] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.876697] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b2d848-23a9-4e59-99fe-f5621d3e6144',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.918841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.919071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.919158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.919402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.919493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.919591] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e is going to be created. [ 831.943351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.943351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.943531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.943633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.943838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.954247] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: UNINITIALIZED for 2s [ 832.001515] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 832.001733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.001898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.002196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.002425] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.002552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.002620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.002834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.002924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.003034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.003160] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.004367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.004367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.004562] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.004709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.004784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.004958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.005112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.005268] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.378881] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.379307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.379307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.379601] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.379789] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.379951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port f2b2d848-23a9-4e59-99fe-f5621d3e6144 not found, creating... [ 832.380260] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.380528] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.380668] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.380916] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.381077] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.381427] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.381546] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.381653] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.381859] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.381988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.382140] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: f2b2d848-23a9-4e59-99fe-f5621d3e6144 is going to be created. [ 832.405575] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.405575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.405575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.405575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.405575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.405575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.510879] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.511161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.511969] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.013925] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-3e09628b-d64a-4c31-b19e-82fa1ed8c198 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-3e09628b-d64a-4c31-b19e-82fa1ed8c198 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [req-36b4d98e-33a6-4993-998d-608b1b00fd3f req-3e09628b-d64a-4c31-b19e-82fa1ed8c198 service nova] Enqueued Resource ID: f2b2d848-23a9-4e59-99fe-f5621d3e6144 with Priority: HIGHEST for action port [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 833.182351] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b2d848-23a9-4e59-99fe-f5621d3e6144 with Priority: HIGHEST for action port [ 833.182351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.182351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.182351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.182351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.182351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2b2d848-23a9-4e59-99fe-f5621d3e6144 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.183313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.183623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.185431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.185431] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b2d848-23a9-4e59-99fe-f5621d3e6144',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.479848] env[65080]: INFO networking_nsxv3.common.synchronization [req-84315fe2-fe59-4ae0-bb76-56d5d0a88464 req-c68c492d-2650-446a-9ef0-44afab5a6223 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 833.480732] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 833.481057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.481195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.481269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.481444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.481582] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.481694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.481764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.481987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.481987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.484067] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.516171] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.518675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.518675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.518675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.518675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.518675] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 833.550325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.550529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.550529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.550746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.550895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.560863] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 833.687395] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2b2d848-23a9-4e59-99fe-f5621d3e6144 with status ACTIVE [ 833.687639] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.687801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.687868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.688272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.688431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.688657] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.688770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.688835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.689009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.689110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.689328] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.689395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.689459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.689600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.689677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.689767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2b2d848-23a9-4e59-99fe-f5621d3e6144 is going to be updated. [ 833.718141] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.718293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.718363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.718680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.718897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.719179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2b2d848-23a9-4e59-99fe-f5621d3e6144" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.847133] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-247 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.847553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.847553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.847724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.848385] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.848385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.848385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.848650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.848650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.848967] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.848967] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.849132] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.849132] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.849829] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.849829] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.849829] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.881689] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.881689] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.881965] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.882122] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.882635] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-1ee1d7f6-a535-4fec-b210-c5c8df30a171 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.882867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.883017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.883426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.883599] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee1d7f6-a535-4fec-b210-c5c8df30a171',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.964318] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: SUCCESS [ 833.964649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.964868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.965139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.965372] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.965560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.965653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.965848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.965945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.966096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.966212] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.986412] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.316064] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 834.316274] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 834.317124] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 834.320031] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 834.320031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.320031] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.320708] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-194ae160-52aa-4c9e-8ce6-49440c5dea8a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320860] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.321338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.321338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.321767] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.378197] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_rules [ 834.378197] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 834.378197] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 834.378197] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 834.378197] env[65080]: INFO networking_nsxv3.common.synchronization [req-81e804e0-6dc2-4cd6-a9cc-190f0f116e2a req-b5b117ef-ee5a-4701-a043-7ab052844b4d tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 834.379030] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_rules [ 834.379341] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 834.379644] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 834.380015] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 834.380389] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 834.380853] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194ae160-52aa-4c9e-8ce6-49440c5dea8a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.381156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.381340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.381723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.381913] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.383405] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.383789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.384043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.384339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.385869] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.387750] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-77862447-9c31-42ac-ace0-4a94fb359564 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.388123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.388397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.388678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.388876] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77862447-9c31-42ac-ace0-4a94fb359564',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.390952] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-194ae160-52aa-4c9e-8ce6-49440c5dea8a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.391682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.391682] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.391682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.392487] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.392670] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.392792] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.393160] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.393567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.393761] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 1ee1d7f6-a535-4fec-b210-c5c8df30a171 not found, creating... [ 834.394260] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.394493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.394648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.394892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.395042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.395340] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.396262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.396411] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.397041] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.397137] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.397328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 1ee1d7f6-a535-4fec-b210-c5c8df30a171 is going to be created. [ 834.423217] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.423491] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.423571] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.423856] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.424109] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.424337] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.472024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.472024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.472024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.472903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.472903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.472903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.472903] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.488288] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.825337] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.825337] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.888422] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.888653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.893164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-194ae160-52aa-4c9e-8ce6-49440c5dea8a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.893360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.893461] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77862447-9c31-42ac-ace0-4a94fb359564 with status ACTIVE [ 834.893624] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.893819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.893873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.894134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.894228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.894428] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.894527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.894593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.894743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.894823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.895019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.895129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.895261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.895415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.895415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.895506] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77862447-9c31-42ac-ace0-4a94fb359564 is going to be updated. [ 834.929577] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.929754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.929803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.930100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.930256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.930433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.979710] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97754e94-da90-4f7b-8c52-b6ebac93d80e: rpc.has_security_group_logging(os_id): False [ 834.993518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.993642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.993722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.993964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.994925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.994925] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 835.018145] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.018145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.018145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.019302] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.019302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.019745] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.019745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.019837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.020572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.020572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.020983] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e is going to be created. [ 835.066263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.066677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.066815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.067078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.067242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.081207] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 835.129199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.129370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.129509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.129827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.130173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.143377] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: IN_PROGRESS for 2s [ 835.180641] env[65080]: INFO networking_nsxv3.common.synchronization [req-84315fe2-fe59-4ae0-bb76-56d5d0a88464 req-4160b3c9-cbf3-4dc1-8939-765d0d16d4f5 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 835.180856] env[65080]: INFO networking_nsxv3.common.synchronization [req-84315fe2-fe59-4ae0-bb76-56d5d0a88464 req-4160b3c9-cbf3-4dc1-8939-765d0d16d4f5 service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 835.180983] env[65080]: INFO networking_nsxv3.common.synchronization [req-84315fe2-fe59-4ae0-bb76-56d5d0a88464 req-4160b3c9-cbf3-4dc1-8939-765d0d16d4f5 service nova] Enqueued Resource ID: 1ee1d7f6-a535-4fec-b210-c5c8df30a171 with Priority: HIGHEST for action port [ 835.181528] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 835.181667] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 835.181767] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ee1d7f6-a535-4fec-b210-c5c8df30a171 with Priority: HIGHEST for action port [ 835.182097] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.183638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.183638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.183998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.184111] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.185849] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.185962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.186134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ee1d7f6-a535-4fec-b210-c5c8df30a171 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.186257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.186322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.186526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.190130] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee1d7f6-a535-4fec-b210-c5c8df30a171',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.326347] env[65080]: INFO networking_nsxv3.common.synchronization [None req-e8bbf351-92ce-4907-b6fc-80b99ac089c9 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 835.327309] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.330405] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 835.331228] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.334120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.334437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.334437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.334836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.335480] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.573328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 835.573776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.573921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.574161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.574410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.574685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.574685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.574907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.575037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.575165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.575361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.575460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.575538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.575807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.575892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.575969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.576044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.576186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.576261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.576342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.576429] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.577516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.577516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.577699] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.577755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.577791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.577994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.577994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.578156] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.690252] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.690252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.693893] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ee1d7f6-a535-4fec-b210-c5c8df30a171 with status ACTIVE [ 835.693893] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.693893] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.693893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.694641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.694641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.694641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.694641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.694641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.694892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.694892] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ee1d7f6-a535-4fec-b210-c5c8df30a171 is going to be updated. [ 835.723630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.723889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.723889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.724221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.724570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.724903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ee1d7f6-a535-4fec-b210-c5c8df30a171" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.831689] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.831689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.831985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.833139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.833139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.833139] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a is going to be created. [ 835.835758] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.835758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.835758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.835758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.835758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.835758] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 835.871193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.871465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.871465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.871655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.871754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.871876] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc already deleted. [ 835.871965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.880873] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.881052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.881124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.881455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.881565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.891710] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a in Status: UNINITIALIZED for 2s [ 835.892765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.892897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.892969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.893176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.893312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.897567] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b7e752fa-aa66-4f51-84f9-90f12f3b83fb tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 835.897567] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 835.897829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.897944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.898015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.898228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.898434] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.912037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 836.079822] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c08a0238-d0a8-47ca-b018-8c7d44286412: rpc.has_security_group_logging(os_id): False [ 836.081384] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.100773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.100917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.100979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.101296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.101516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.101618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.101664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.101818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.101895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.102076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.102167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.102315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.102373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.102446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.102629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.102716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.102775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.102913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.102985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.103082] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be created. [ 836.178211] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.178350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.178432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.178651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.178946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.194374] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 836.430104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.430445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.430606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.431100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.431229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.431520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc already deleted. [ 836.431520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.588370] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.012646] env[65080]: INFO networking_nsxv3.common.synchronization [req-1e275727-ef61-4711-a7bb-83d3c1847242 req-61c9afaa-43cb-4637-82c0-08b0308375ae tempest-ServerMetadataTestJSON-1506581219 tempest-ServerMetadataTestJSON-1506581219-project-member] Enqueued Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 837.013492] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 837.013638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.013786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.013835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.014183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.014345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.014480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.014546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.014740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.014845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.014958] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.091706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.091706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.091706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.092161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.092161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.092249] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 837.094497] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 837.094704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.094788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.094981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.095173] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.095311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.095408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.095582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.095661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.095756] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.142628] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.144082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.144082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.144082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.144082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.158664] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 837.161037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: SUCCESS [ 837.161469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.279349] env[65080]: INFO networking_nsxv3.common.synchronization [req-a7270435-620a-4a52-827c-afeb63b85094 req-2f542801-57d8-4fbe-be41-0f2623ebfc94 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 837.279527] env[65080]: INFO networking_nsxv3.common.synchronization [req-a7270435-620a-4a52-827c-afeb63b85094 req-2f542801-57d8-4fbe-be41-0f2623ebfc94 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 837.280236] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 837.280236] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a with Priority: HIGHEST for action security_group_members [ 837.280943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.280943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.280943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-194ae160-52aa-4c9e-8ce6-49440c5dea8a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.280943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.340049] env[65080]: INFO networking_nsxv3.common.synchronization [req-a7270435-620a-4a52-827c-afeb63b85094 req-2f542801-57d8-4fbe-be41-0f2623ebfc94 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 837.340049] env[65080]: INFO networking_nsxv3.common.synchronization [req-a7270435-620a-4a52-827c-afeb63b85094 req-2f542801-57d8-4fbe-be41-0f2623ebfc94 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 837.340049] env[65080]: INFO networking_nsxv3.common.synchronization [req-a7270435-620a-4a52-827c-afeb63b85094 req-2f542801-57d8-4fbe-be41-0f2623ebfc94 tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 837.341181] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_rules [ 837.341600] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 837.342331] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77862447-9c31-42ac-ace0-4a94fb359564 with Priority: HIGHEST for action port [ 837.342331] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.342580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343947] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.343947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343947] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-77862447-9c31-42ac-ace0-4a94fb359564 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.343947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.343947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.343947] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77862447-9c31-42ac-ace0-4a94fb359564',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.518285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.518472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.518572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.518956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.519045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.519221] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.519323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.519392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.519599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.519687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.519777] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a already deleted. [ 837.519863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.523068] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.523331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-404" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.523452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-404" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.523766] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-404" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.524041] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.524205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.524318] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.524630] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.524766] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.524974] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.525097] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.525206] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.525310] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.525442] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.525554] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.525683] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.552217] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.552546] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.552698] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.552882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-404" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.553213] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-4027fd1f-f281-4da9-a460-2ac7f055797c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.553391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.553510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.553835] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.553966] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4027fd1f-f281-4da9-a460-2ac7f055797c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.597649] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.850010] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77862447-9c31-42ac-ace0-4a94fb359564 with status ACTIVE [ 837.850450] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.850686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.850831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.851216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.851393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.851716] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.851908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.852048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.852346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.852589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.852926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.853150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.853252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.853537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.853693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.853869] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77862447-9c31-42ac-ace0-4a94fb359564 is going to be updated. [ 837.879876] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.880038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.880176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.880561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.880820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.881218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77862447-9c31-42ac-ace0-4a94fb359564" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.904230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a in Status: SUCCESS [ 837.905379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.905379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.905379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.905379] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.905715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.905715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.905782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.905929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.905979] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.924265] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 837.924265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.924265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.924551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.924754] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.924874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.924941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.925119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.925206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.925307] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.057129] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.057419] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.057546] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.057942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.058043] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.058140] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 4027fd1f-f281-4da9-a460-2ac7f055797c not found, creating... [ 838.058408] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.058575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.058705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.058936] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.059075] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.059365] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.059523] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.059635] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.059837] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.059966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.060119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 4027fd1f-f281-4da9-a460-2ac7f055797c is going to be created. [ 838.088858] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.088858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.088858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.088858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.088858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.088858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.100247] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.209122] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 838.209620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.209764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.209942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.210087] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.411439] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.411698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.411698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.412189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.412189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.412382] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.412547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.412641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.412819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.412976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.413030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a is going to be deleted. [ 838.427862] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.482511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.482783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.482888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.483230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.483395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.483586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.483841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.484144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.484472] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.484655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.484816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.484988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.485152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.485318] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.603404] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.603404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.603404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.603842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.603842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.603842] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 838.641593] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.642394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.642538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.642761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.644804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.659371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 838.712421] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.712586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.860853] env[65080]: INFO networking_nsxv3.common.synchronization [req-1e275727-ef61-4711-a7bb-83d3c1847242 req-186d51d4-9065-4d17-aba7-6598c927bcad service nova] Enqueued Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_rules [ 838.861139] env[65080]: INFO networking_nsxv3.common.synchronization [req-1e275727-ef61-4711-a7bb-83d3c1847242 req-186d51d4-9065-4d17-aba7-6598c927bcad service nova] Enqueued Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 838.861222] env[65080]: INFO networking_nsxv3.common.synchronization [req-1e275727-ef61-4711-a7bb-83d3c1847242 req-186d51d4-9065-4d17-aba7-6598c927bcad service nova] Enqueued Resource ID: 4027fd1f-f281-4da9-a460-2ac7f055797c with Priority: HIGHEST for action port [ 838.861743] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_rules [ 838.861884] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 838.862214] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4027fd1f-f281-4da9-a460-2ac7f055797c with Priority: HIGHEST for action port [ 838.862495] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.862616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.862616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.862932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.863031] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.864145] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.864272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.864519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.865172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.865172] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.865172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.865172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.865172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.865172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.865416] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.866297] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4027fd1f-f281-4da9-a460-2ac7f055797c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.866297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.866451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.866485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.866809] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4027fd1f-f281-4da9-a460-2ac7f055797c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.932052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.989032] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.989523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.991427] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.991427] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a already deleted. [ 838.991427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.991427] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.994152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.994410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.994809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.995068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.995178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.995405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.995597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.995597] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.174222] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 839.174222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.174222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.174222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.174222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.174222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.175257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175877] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.368320] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.371164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.371316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.371582] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4027fd1f-f281-4da9-a460-2ac7f055797c with status ACTIVE [ 839.371870] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.372043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.372143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.372488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.372723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.373139] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.374014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.374014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.374014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.374014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.374630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.374630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.374630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.374955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.375023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.375291] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4027fd1f-f281-4da9-a460-2ac7f055797c is going to be updated. [ 839.408479] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.408757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.408850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.410695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.410695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.410695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4027fd1f-f281-4da9-a460-2ac7f055797c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.434546] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.434546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.434546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.434546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.434546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.434883] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 839.497958] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194ae160-52aa-4c9e-8ce6-49440c5dea8a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.499165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.499386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.499455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.499726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.499875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.500193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.500354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.500456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.500796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.500927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.501247] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a already deleted. [ 839.501395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.505079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.505316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.505451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.505799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.506100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.526235] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 839.678838] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.679236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.679236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.679382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.679565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.679693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.679737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.679931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.680027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.680122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.680275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.680479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.680479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.680615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.680723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.680884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.680884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.681046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.681131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.681208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.681295] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.878857] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.002658] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194ae160-52aa-4c9e-8ce6-49440c5dea8a: rpc.has_security_group_logging(os_id): False [ 840.026092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.026092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.026092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.026092] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a is going to be created. [ 840.051620] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a], does not exist path=[/infra/domains/default/groups/194ae160-52aa-4c9e-8ce6-49440c5dea8a]."\n}' [ 840.051620] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a [ 840.051620] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 840.088751] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.088944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.089016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.089245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.090949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.090949] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.091227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.091512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.091834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.092162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.092742] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.092742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.093363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.093363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.093363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.093465] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194ae160-52aa-4c9e-8ce6-49440c5dea8a is going to be created. [ 840.117479] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a], does not exist path=[/infra/domains/default/groups/194ae160-52aa-4c9e-8ce6-49440c5dea8a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a [ 840.117629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194ae160-52aa-4c9e-8ce6-49440c5dea8a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.117847] env[65080]: Traceback (most recent call last): [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 840.117902] env[65080]: return func(*args, **kwargs) [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 840.117902] env[65080]: res.raise_for_status() [ 840.117902] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 840.117902] env[65080]: raise HTTPError(http_error_msg, response=self) [ 840.117902] env[65080]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a [ 840.117902] env[65080]: During handling of the above exception, another exception occurred: [ 840.117902] env[65080]: Traceback (most recent call last): [ 840.117902] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 840.117902] env[65080]: listener.cb(fileno) [ 840.117902] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 840.117902] env[65080]: result = function(*args, **kwargs) [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 840.117902] env[65080]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 840.117902] env[65080]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 840.117902] env[65080]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 840.117902] env[65080]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 840.117902] env[65080]: res.raise_for_status() [ 840.117902] env[65080]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 840.117902] env[65080]: raise HTTPError(http_error_msg, response=self) [ 840.117902] env[65080]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/194ae160-52aa-4c9e-8ce6-49440c5dea8a [ 840.118660] env[65080]: Removing descriptor: 58 [ 840.183436] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c08a0238-d0a8-47ca-b018-8c7d44286412: rpc.has_security_group_logging(os_id): False [ 840.202719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.203257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.203379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.204171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.234945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.234945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.234945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.234945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.235592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.235592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.235592] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 840.354773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.354773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.354773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.354773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.354773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.380124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 840.383622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.383622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.383622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.383622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.383622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.383622] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a is going to be created. [ 840.431719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.431719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.431719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.431719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.431719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.446782] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: UNINITIALIZED for 2s [ 840.670641] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 840.670931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.671265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.671508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.671666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.671817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.671903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.672149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.672344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.672468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.672534] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.175360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.175901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.175901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.176057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.176310] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.176460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.176545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.176785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.176967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.177122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.177366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.177524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.177654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.177908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.178144] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.178319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.178443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.178728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.178931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.178986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.179103] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.538012] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 841.538279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.538476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.538847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.539071] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.539206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.539278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.539445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.539553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.539661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.539767] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.540724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.540946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.541164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.541340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.541385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.541598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.541699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.541845] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.682030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 379c83f4-3ef4-4263-aff5-1c9a7750a19a: rpc.has_security_group_logging(os_id): False [ 841.715252] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.715540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.715623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.715852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.741306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.741754] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.741901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.741989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.742209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.742526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.742665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.742806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.742806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.742968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.743123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.743333] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.743432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.743496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.743639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.743776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.743871] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 841.820439] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.820601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.820665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.820864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.821016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.840264] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 842.043765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.044020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.044154] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.397969] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 842.397969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.398347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.398347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.398347] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.463721] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: SUCCESS [ 842.463912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.464104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.464357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.464548] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.464677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.464746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.465111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.465111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.465111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.465219] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.547051] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.903572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.903758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.903758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.903978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.904169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.904271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.904331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.904584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.904675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.904768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.904860] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.968094] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.969297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.969297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.969297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.969578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.969578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.969710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.970505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.970505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.970505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.970505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.970738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.970895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.971826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.972335] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.972505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.973806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.973806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.973806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.973806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.973806] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.049564] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.052733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.052733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.052733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.052733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.052733] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 843.083959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.084306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.084306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.084542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.084605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.096269] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 843.412353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.412353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.412353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.412353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.412353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.413334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.413334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.413334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.413334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.413334] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.476600] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 139f1c3c-a779-4214-88d4-1b7cd2dfa63a: rpc.has_security_group_logging(os_id): False [ 843.498552] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.498811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.499463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.499463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.499463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.499680] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.499901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.500597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.500597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.500597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.500597] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.500597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.501414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.501414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.501414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.501414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.501628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.501628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.501692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.501725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.505021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a is going to be created. [ 843.582139] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.582139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.582139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.582139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.582139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.596319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: IN_PROGRESS for 2s [ 843.862683] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 843.862875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.863126] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 843.863201] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 843.917844] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c08a0238-d0a8-47ca-b018-8c7d44286412: rpc.has_security_group_logging(os_id): False [ 843.942016] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.942198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.942273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.942769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.944972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.944972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.944972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.945470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.945470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.945470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.945470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.945470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.945470] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 844.014295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.014692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.014692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.014811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.014930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.034411] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 845.108552] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 845.109246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.109246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.109438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.109511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.109621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.109685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.109846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.109932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.110069] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.612394] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.615746] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: SUCCESS [ 845.615746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.052319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 846.052319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.116927] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.619775] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.620172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.620172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.620496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.620641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.620798] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 846.655502] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.655502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.655502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.655502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.655753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.666565] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 847.978427] env[65080]: INFO networking_nsxv3.common.synchronization [req-d890ca82-b2af-4565-9b23-56e54f803b3d req-5a38f873-d55e-436c-a591-3774b33aabdb tempest-ServerAddressesNegativeTestJSON-147507694 tempest-ServerAddressesNegativeTestJSON-147507694-project-member] Enqueued Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 847.983043] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGHEST for action security_group_members [ 847.983803] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.983945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.984020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.984247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.984414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.984734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.984816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.984990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.985103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.985205] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.487998] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.488214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.488291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.488507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.510517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.510517] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.510517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.510517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.510517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.511190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.511190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e is going to be updated. [ 848.544132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.544400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.544400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.544720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.544901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.554628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: IN_PROGRESS for 2s [ 848.680185] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.680185] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.680185] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.680185] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.680185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.681015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.681015] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.183254] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ff651ba-db91-4903-b7c9-61210ba27bf2: rpc.has_security_group_logging(os_id): False [ 849.208249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.208387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.208528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.208670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.234060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.234657] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.234846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.234931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.235163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.235242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.235613] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.235724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.235790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.235983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.236080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.236295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.236368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.236431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.236567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.236672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.236733] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 849.319253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.319388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.319488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.319806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.320491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.324785] env[65080]: INFO networking_nsxv3.common.synchronization [req-80b6c294-c1c3-40e9-ac6b-3ffb2a75e3e0 req-d197709f-0832-4da2-815f-e4be3d50f1a5 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 849.325183] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 849.325578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.325768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.325848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.326081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.326255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.326384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.326461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.326645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.326737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.326838] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.336333] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 849.749992] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.750232] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.751822] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.751822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.753378] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.753378] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.753378] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.753378] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.753378] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.753378] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.753378] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.772534] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.772728] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.772874] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.773056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.773363] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-540aff97-a882-46e9-a892-a89ca2091868 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.773532] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.773648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.773985] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.774165] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('540aff97-a882-46e9-a892-a89ca2091868',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.829294] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.829294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.829294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.829691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.829691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.829790] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.829863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.829912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.830051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.830135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.830211] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c already deleted. [ 849.830343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.277886] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.278321] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.278321] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.278530] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.278674] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.279009] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 540aff97-a882-46e9-a892-a89ca2091868 not found, creating... [ 850.279302] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.279463] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.279576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.279805] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.279938] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.280235] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.280385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.280496] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.280698] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.280824] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.280956] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 540aff97-a882-46e9-a892-a89ca2091868 is going to be created. [ 850.302975] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.303215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.303339] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.303755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.303982] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.304227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.369220] env[65080]: INFO networking_nsxv3.common.synchronization [None req-a655a6e0-af32-41b3-9ff4-e1d69361697b tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: b6bf9824-260c-4095-9e46-dec6aef1278b with Priority: HIGHEST for action security_group_rules [ 850.369832] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6bf9824-260c-4095-9e46-dec6aef1278b with Priority: HIGHEST for action security_group_rules [ 850.370172] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6bf9824-260c-4095-9e46-dec6aef1278b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.370390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.370390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.370617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.370730] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6bf9824-260c-4095-9e46-dec6aef1278b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.538427] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c019c71b-067b-465c-b512-b4b1a7d3d9e6 tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: b6bf9824-260c-4095-9e46-dec6aef1278b with Priority: HIGHEST for action security_group_rules [ 850.538978] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6bf9824-260c-4095-9e46-dec6aef1278b with Priority: HIGHEST for action security_group_rules [ 850.539297] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6bf9824-260c-4095-9e46-dec6aef1278b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.539401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.578652] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e in Status: SUCCESS [ 850.578652] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e deletion is rescheduled due to dependency. [ 850.578652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.894638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.894928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.894928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.895130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.895594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.895594] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6bf9824-260c-4095-9e46-dec6aef1278b already deleted. [ 850.895594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.895892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.895892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.895990] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6bf9824-260c-4095-9e46-dec6aef1278b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [req-80b6c294-c1c3-40e9-ac6b-3ffb2a75e3e0 req-b7548936-6c92-46fa-9d5f-aa415e9dc6e3 service nova] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [req-80b6c294-c1c3-40e9-ac6b-3ffb2a75e3e0 req-b7548936-6c92-46fa-9d5f-aa415e9dc6e3 service nova] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [req-80b6c294-c1c3-40e9-ac6b-3ffb2a75e3e0 req-b7548936-6c92-46fa-9d5f-aa415e9dc6e3 service nova] Enqueued Resource ID: 540aff97-a882-46e9-a892-a89ca2091868 with Priority: HIGHEST for action port [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_rules [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 851.054666] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540aff97-a882-46e9-a892-a89ca2091868 with Priority: HIGHEST for action port [ 851.054666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.055030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.055030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.055030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.055174] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.056865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.057016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.057096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.057312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.057497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.057621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.057688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.057861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.057963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.059168] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.060051] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-540aff97-a882-46e9-a892-a89ca2091868 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.060192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.060253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.060436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.060519] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('540aff97-a882-46e9-a892-a89ca2091868',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.352243] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 851.352504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.353361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.353697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.353829] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.419130] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.419253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.419301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.419489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.419594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.419705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6bf9824-260c-4095-9e46-dec6aef1278b already deleted. [ 851.421204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6bf9824-260c-4095-9e46-dec6aef1278b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.563021] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.563754] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.564645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.564866] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 540aff97-a882-46e9-a892-a89ca2091868 with status ACTIVE [ 851.565089] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.565230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.565301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.565786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.565786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.565916] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.565981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.566069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.566236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.566315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.566505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.566617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.566699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.566861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.566965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.567018] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 540aff97-a882-46e9-a892-a89ca2091868 is going to be updated. [ 851.593357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.593685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.593685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.593878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.594090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.594259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-540aff97-a882-46e9-a892-a89ca2091868" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.858614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.858614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.858614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.858614] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.069447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.237676] env[65080]: INFO networking_nsxv3.common.synchronization [req-770b3070-c4bd-4b70-ba16-28d001519992 req-ddeffc78-70fb-4313-bc13-8b7595f00fa4 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 852.238288] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 852.238656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.238774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.238841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.239342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.239342] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.239342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.239342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.239546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.239546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.239763] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.360746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.361076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.361076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.362171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.362171] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.363045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.363105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.363283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.363372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.363465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.363634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.363827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.363883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.364102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.364409] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.364409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.364409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.364598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.364598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.365531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.365531] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.573671] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.573671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.573795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.574029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.574129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.574236] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c is going to be created. [ 852.601800] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.602079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.602195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.602438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.602735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.615015] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: UNINITIALIZED for 2s [ 852.731338] env[65080]: INFO networking_nsxv3.common.synchronization [req-5ad2cb52-487b-48eb-a0e6-3c691052debb req-dffa7e3f-0b52-4e5c-b527-eb23248bfcbe tempest-ServerRescueTestJSONUnderV235-551811606 tempest-ServerRescueTestJSONUnderV235-551811606-project-member] Enqueued Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 852.731894] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 with Priority: HIGHEST for action security_group_members [ 852.732229] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ff651ba-db91-4903-b7c9-61210ba27bf2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.732356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.732422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.732653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.732815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.732915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.732977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.733797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.733934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.734081] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ff651ba-db91-4903-b7c9-61210ba27bf2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.741016] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.872519] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ff651ba-db91-4903-b7c9-61210ba27bf2: rpc.has_security_group_logging(os_id): False [ 852.896150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.896290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.896374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.896701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.896761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.896981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.897135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.897224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.897445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.897570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.897889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.898397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.898397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.898523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.898666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.898898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.899359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.899359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.899517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.899601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.899666] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 852.983720] env[65080]: INFO networking_nsxv3.common.synchronization [req-770b3070-c4bd-4b70-ba16-28d001519992 req-41bf500b-7804-49d8-aafc-c14d8b48dc94 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 852.984271] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 852.984637] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.984743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.989340] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.989493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.989584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.989793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.989937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.005999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 853.236672] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.236878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.236937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.237196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.237361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.237571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.237676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.237753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.237959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.238063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.238152] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 is going to be updated. [ 853.242895] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.287962] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.288389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.288523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.288974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.289209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.303046] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: IN_PROGRESS for 2s [ 853.343153] env[65080]: INFO networking_nsxv3.common.synchronization [req-770b3070-c4bd-4b70-ba16-28d001519992 req-da8f947e-0f32-432d-89d4-5448c5b52077 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 853.344058] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 853.344329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.344429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.746041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.746379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.746379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.746485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.746530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.746633] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 853.787090] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.787090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.787264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.787373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.787523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.801737] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 854.625970] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: SUCCESS [ 854.626325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.626520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.626740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.627014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.627163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.627251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.627428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.627535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.627627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.627737] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.687504] env[65080]: INFO networking_nsxv3.common.synchronization [req-08445cb8-d33f-4d3b-882d-d9922d5448d8 req-fef26e52-20d7-4455-8e9b-81efe24ffddc tempest-FloatingIPsAssociationNegativeTestJSON-339216273 tempest-FloatingIPsAssociationNegativeTestJSON-339216273-project-member] Enqueued Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 854.688131] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGHEST for action security_group_members [ 854.688455] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.688577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.689285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.689571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.689811] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.691216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.691383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.691717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.691881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.692064] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.022809] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 855.024350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.131964] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.195070] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.195238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.195307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.195530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.222828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.222828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.222828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.223067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.223105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.223208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.223292] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 is going to be updated. [ 855.252033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.252033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.253209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.253209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.253209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.264397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: IN_PROGRESS for 2s [ 855.312599] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 in Status: SUCCESS [ 855.312817] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ff651ba-db91-4903-b7c9-61210ba27bf2 deletion is rescheduled due to dependency. [ 855.312960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ff651ba-db91-4903-b7c9-61210ba27bf2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.415585] env[65080]: INFO networking_nsxv3.common.synchronization [req-30a6589b-eedf-4413-a165-56feb62fa47e req-3764bdb7-1e2a-43ef-bbc0-9e772e9df2bd tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 855.415855] env[65080]: INFO networking_nsxv3.common.synchronization [req-30a6589b-eedf-4413-a165-56feb62fa47e req-3764bdb7-1e2a-43ef-bbc0-9e772e9df2bd tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 855.415946] env[65080]: INFO networking_nsxv3.common.synchronization [req-30a6589b-eedf-4413-a165-56feb62fa47e req-3764bdb7-1e2a-43ef-bbc0-9e772e9df2bd tempest-SecurityGroupsTestJSON-90077812 tempest-SecurityGroupsTestJSON-90077812-project-member] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 855.416655] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 with Priority: HIGHEST for action security_group_members [ 855.416762] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGHEST for action security_group_members [ 855.416835] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGHEST for action security_group_members [ 855.417088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.417214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.417277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.417478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.417640] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.417740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.417804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.417945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.418045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.418142] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.420829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.420934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.420990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.421141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.421289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.421386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.421636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.421636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.421763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.421763] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.422559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.422673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.422739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.422982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.423060] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.423833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.423833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.423833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.423833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.424112] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.549641] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7e41383e-408c-4844-9c23-5a4d44548890 None None] Enqueued Resource ID: 7330a59b-6d50-4b07-ac73-5fd4b541e478 with Priority: HIGHEST for action port [ 855.550295] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7330a59b-6d50-4b07-ac73-5fd4b541e478 with Priority: HIGHEST for action port [ 855.550658] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7330a59b-6d50-4b07-ac73-5fd4b541e478 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.550787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7330a59b-6d50-4b07-ac73-5fd4b541e478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.550852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7330a59b-6d50-4b07-ac73-5fd4b541e478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.551363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7330a59b-6d50-4b07-ac73-5fd4b541e478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.551480] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7330a59b-6d50-4b07-ac73-5fd4b541e478',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.634494] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3269206-fb2c-48bf-b03a-c5065b747a8c: rpc.has_security_group_logging(os_id): False [ 855.653290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.653432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.653543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.653707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.653799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.654045] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.654232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.654307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.654450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.654620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.654680] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c is going to be created. [ 855.728807] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.729040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.729158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.729492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.729769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.745942] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: IN_PROGRESS for 2s [ 855.816235] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 855.816460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.816910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.817091] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.817221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.817286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.817469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.817567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.817704] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.923824] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.923824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.923824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.923824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.926521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.926861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.927411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.927411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.946194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.949024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.949024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.949024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.949024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.949024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.949024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 is going to be updated. [ 855.951825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.951825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.991338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.991611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.991767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.991864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.992154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.992257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.992339] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be updated. [ 855.993748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.993748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.024486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.024713] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.024858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.024920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.026646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.026646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.026646] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be updated. [ 856.029052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.029052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.029052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.029497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.029497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.047566] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: IN_PROGRESS for 2s [ 856.048762] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.048918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.049149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.049454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.049506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.053320] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7330a59b-6d50-4b07-ac73-5fd4b541e478 [ 856.053572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.053684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.053754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.053962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.054075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.054268] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7330a59b-6d50-4b07-ac73-5fd4b541e478 already deleted. [ 856.054458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7330a59b-6d50-4b07-ac73-5fd4b541e478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.065490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: IN_PROGRESS for 2s [ 856.092694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.093179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.093179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.093380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.093615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.105066] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: IN_PROGRESS for 2s [ 856.323034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.323034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.323034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.323034] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 856.372634] env[65080]: INFO networking_nsxv3.common.synchronization [None req-fa1de4cf-7387-465b-88de-6810444e497a tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 856.375765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.375765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.375765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.377370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.377609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.381030] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 856.381030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.381030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.381030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.381030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.381030] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.395158] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 856.483870] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d192942c-b767-4313-8e47-c662a4694066 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 856.484436] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 856.484594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.488308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.900764] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.901056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.901108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.901288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.901376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.901474] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 already deleted. [ 856.901556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.901706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.901856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.901936] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.274331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 in Status: SUCCESS [ 857.274728] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 deletion is rescheduled due to dependency. [ 857.274728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.431406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.431601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.431601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.431896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.431990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.432101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 already deleted. [ 857.432186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.764201] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: SUCCESS [ 857.764441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.964722] env[65080]: INFO networking_nsxv3.common.synchronization [None req-31ad04ec-4be8-4cb1-becf-21fbf7f9d02f None None] Enqueued Resource ID: a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc with Priority: HIGHEST for action port [ 857.965373] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc with Priority: HIGHEST for action port [ 857.965774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.965901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.965982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.967081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.967296] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.063909] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 in Status: SUCCESS [ 858.063909] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957 deletion is rescheduled due to dependency. [ 858.063909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.079164] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a859d56-1200-4947-a281-afd910811864 in Status: SUCCESS [ 858.079797] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a859d56-1200-4947-a281-afd910811864 deletion is rescheduled due to dependency. [ 858.079797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.116279] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 in Status: SUCCESS [ 858.116279] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 deletion is rescheduled due to dependency. [ 858.116506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.407786] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 858.407786] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 deletion is rescheduled due to dependency. [ 858.407786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.407786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.408334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.408334] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.408334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.408334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.408526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.408563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.408666] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.470215] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc [ 858.470466] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.470614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.470686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.470901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.471062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.471214] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc already deleted. [ 858.471413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a11c9c27-c9ff-44bb-9e5e-95587d5ab1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.914389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.914736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.914736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.915042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.915042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.915259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.915259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.915520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.915520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.915520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.915696] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 858.950257] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.950257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.950568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.950734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.951137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.966861] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 859.331979] env[65080]: INFO networking_nsxv3.common.synchronization [req-766f512f-8b93-4201-b85b-3d391f73c7a7 req-80d70dfb-5c05-4a7c-90c7-df2f5514dc75 tempest-ServerMetadataTestJSON-1506581219 tempest-ServerMetadataTestJSON-1506581219-project-member] Enqueued Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 859.332965] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a with Priority: HIGHEST for action security_group_members [ 859.333627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.333627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.333627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.333833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.333985] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.334217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.334217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.334302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.334413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.334474] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('139f1c3c-a779-4214-88d4-1b7cd2dfa63a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.839191] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.839191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.839191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.839191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.839191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.839706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.839706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.839706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.839706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.839872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.839872] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a is going to be updated. [ 859.875054] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.875355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.875355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.875670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.876234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.888537] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: IN_PROGRESS for 2s [ 860.978329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 860.978625] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 deletion is rescheduled due to dependency. [ 860.978625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.898184] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a in Status: SUCCESS [ 861.898393] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 139f1c3c-a779-4214-88d4-1b7cd2dfa63a deletion is rescheduled due to dependency. [ 861.898477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-139f1c3c-a779-4214-88d4-1b7cd2dfa63a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.721055] env[65080]: INFO networking_nsxv3.common.synchronization [req-aed15dd5-8a5d-4491-8cf4-635aff642342 req-a2e058cc-eaff-4351-993a-ddfca12e8248 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 862.721516] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 862.721834] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.722381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.722593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.722802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.723693] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.724163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.724264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.724465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.724618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.724761] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.054847] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.055041] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.055112] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.055435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.055974] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.056100] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.056761] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.056761] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.056893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.057094] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.057247] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.057385] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.057553] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.057629] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.057745] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.057953] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.082384] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.082384] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.082384] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.082384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.082384] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c2c40e80-7cfe-424e-920c-f06b6efded13 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.082384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.082384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.082384] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.082384] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c40e80-7cfe-424e-920c-f06b6efded13',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.227517] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.227873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.228156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.228505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.228613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.228738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.228893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.229111] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc already deleted. [ 863.229210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.587451] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.587643] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.587767] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.588218] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.588401] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.588559] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c2c40e80-7cfe-424e-920c-f06b6efded13 not found, creating... [ 863.588874] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.589051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.589171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.589397] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.589530] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.589817] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.589970] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.590096] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.590298] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.590650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.590650] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c2c40e80-7cfe-424e-920c-f06b6efded13 is going to be created. [ 863.609759] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.609995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.610138] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.610439] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.610709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.610928] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.414082] env[65080]: INFO networking_nsxv3.common.synchronization [req-aed15dd5-8a5d-4491-8cf4-635aff642342 req-4d7c0286-c61c-447b-8bd7-d65d58573834 service nova] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 864.414082] env[65080]: INFO networking_nsxv3.common.synchronization [req-aed15dd5-8a5d-4491-8cf4-635aff642342 req-4d7c0286-c61c-447b-8bd7-d65d58573834 service nova] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 864.414082] env[65080]: INFO networking_nsxv3.common.synchronization [req-aed15dd5-8a5d-4491-8cf4-635aff642342 req-4d7c0286-c61c-447b-8bd7-d65d58573834 service nova] Enqueued Resource ID: c2c40e80-7cfe-424e-920c-f06b6efded13 with Priority: HIGHEST for action port [ 864.414082] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_rules [ 864.414082] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 864.415351] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c40e80-7cfe-424e-920c-f06b6efded13 with Priority: HIGHEST for action port [ 864.417085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.417085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.417085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.417456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.417622] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.419340] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.420093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.420196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.421212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.421212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.422393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.422393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.422393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.422393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.422393] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.423904] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c40e80-7cfe-424e-920c-f06b6efded13 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.423904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.423904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.423904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.423904] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c40e80-7cfe-424e-920c-f06b6efded13',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.925629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.925735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.925928] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.927681] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2c40e80-7cfe-424e-920c-f06b6efded13 with status ACTIVE [ 864.928126] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.928126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.928126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.928340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.928384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.928548] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.928649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.928744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.928866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.929424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.929658] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.930386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.930386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.930386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.930386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.930386] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2c40e80-7cfe-424e-920c-f06b6efded13 is going to be updated. [ 864.953178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.953337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.953411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.953643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.953785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.953952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c40e80-7cfe-424e-920c-f06b6efded13" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.432771] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.935419] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.935579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.935831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.936044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.936225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.936304] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc is going to be created. [ 865.966203] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.966426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.966529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.966832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.967044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.977952] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: UNINITIALIZED for 2s [ 867.989171] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: SUCCESS [ 867.989568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.989607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.989894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.990105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.990220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.990286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.990453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.990525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.990612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.990705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.493705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.001443] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74ec0c67-3f18-478e-834a-86d63bd247dc: rpc.has_security_group_logging(os_id): False [ 869.017998] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.018226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.018285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.018762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.018968] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.019386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.019592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.019738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.020038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.020225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.020376] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc is going to be created. [ 869.084079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.084330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.084405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.084743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.085039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.100681] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: IN_PROGRESS for 2s [ 869.416716] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 869.416827] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 871.114944] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: SUCCESS [ 871.115242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.270657] env[65080]: INFO networking_nsxv3.common.synchronization [req-bbfc8156-ad5f-4cc3-bcfd-e38bbbaaab68 req-bdcf449a-833f-429d-a0d5-c4964e3bf0dd tempest-ServersAdminNegativeTestJSON-1839845653 tempest-ServersAdminNegativeTestJSON-1839845653-project-member] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 872.270959] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 872.271271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.271399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.271463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.271703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.271861] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.271959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.272032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.272325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.272432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.272527] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.571623] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.571623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.571623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.571623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.571623] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.571940] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.572278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.572608] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.572858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.573195] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.573404] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.573595] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.573777] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.573972] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.574174] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.574416] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.599030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.599824] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.600128] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.600409] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.600824] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-e42ad141-e2db-4604-9a5e-40a4bf7901ca taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.601203] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.601430] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.601858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.602393] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42ad141-e2db-4604-9a5e-40a4bf7901ca',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.774854] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.775109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.775332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.775422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.775619] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.775717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.775781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.775962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.776011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.776088] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 already deleted. [ 872.776203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.104780] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.105329] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.105508] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.105862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.106031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.106984] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port e42ad141-e2db-4604-9a5e-40a4bf7901ca not found, creating... [ 873.106984] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.106984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.106984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.106984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.107196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.107375] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.107533] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.107650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.107888] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.108638] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.108813] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: e42ad141-e2db-4604-9a5e-40a4bf7901ca is going to be created. [ 873.130075] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.130310] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.130433] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.131040] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.131382] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.131628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.839233] env[65080]: INFO networking_nsxv3.common.synchronization [req-bbfc8156-ad5f-4cc3-bcfd-e38bbbaaab68 req-3f3fa181-d905-4ccf-af89-a99783f7178b service nova] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_rules [ 873.839481] env[65080]: INFO networking_nsxv3.common.synchronization [req-bbfc8156-ad5f-4cc3-bcfd-e38bbbaaab68 req-3f3fa181-d905-4ccf-af89-a99783f7178b service nova] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 873.839537] env[65080]: INFO networking_nsxv3.common.synchronization [req-bbfc8156-ad5f-4cc3-bcfd-e38bbbaaab68 req-3f3fa181-d905-4ccf-af89-a99783f7178b service nova] Enqueued Resource ID: e42ad141-e2db-4604-9a5e-40a4bf7901ca with Priority: HIGHEST for action port [ 873.840080] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_rules [ 873.840340] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 873.840374] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42ad141-e2db-4604-9a5e-40a4bf7901ca with Priority: HIGHEST for action port [ 873.840649] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.840746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.840815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.841088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.841178] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.842035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.842965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.842965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.842965] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.846306] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e42ad141-e2db-4604-9a5e-40a4bf7901ca taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.846306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.846306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.846824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.846824] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e42ad141-e2db-4604-9a5e-40a4bf7901ca',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.349329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.349329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.349329] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.352180] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e42ad141-e2db-4604-9a5e-40a4bf7901ca with status ACTIVE [ 874.352180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.352180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.352180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.352427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.352648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.352894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.354240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.354240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.354240] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e42ad141-e2db-4604-9a5e-40a4bf7901ca is going to be updated. [ 874.377017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.377017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.377017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.377017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.377017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.377468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e42ad141-e2db-4604-9a5e-40a4bf7901ca" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.853547] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.356250] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.358019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.358019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.358019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.358019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.358019] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be created. [ 875.385299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.385442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.385503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.386544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.386544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.398202] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: UNINITIALIZED for 2s [ 875.532411] env[65080]: INFO networking_nsxv3.common.synchronization [req-2bcb1610-197d-4beb-bca0-f38fdda1136b req-ced57756-5cca-40d4-862c-f36b35611846 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 875.532977] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 875.533318] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.533442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.533496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.533803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.533862] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.533944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.533985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.534450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.534545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.534710] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.911448] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-247 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.911448] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.911448] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.911975] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.915204] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.915204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.915204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.915204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.915204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.915204] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.915204] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.915204] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.915204] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.915544] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.915544] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.915544] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.935091] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.935266] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.935409] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.935719] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-247" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.936045] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-5b28a506-b09c-4e85-bebb-1863d87be136 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.936232] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.936394] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.936733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.936900] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b28a506-b09c-4e85-bebb-1863d87be136',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.038085] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.442391] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.442685] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.442685] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.443017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.443130] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.443208] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 5b28a506-b09c-4e85-bebb-1863d87be136 not found, creating... [ 876.443473] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.443633] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.443747] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.444278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.444278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.444547] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.444757] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.444883] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.445113] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.445247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.445384] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 5b28a506-b09c-4e85-bebb-1863d87be136 is going to be created. [ 876.469695] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.471152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.471152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.471152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.471152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.471152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.540653] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.043132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.043417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.043417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.043750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.043750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.043834] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 877.078039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.078198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.078198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.078389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.078527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.088436] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 877.298794] env[65080]: INFO networking_nsxv3.common.synchronization [req-2bcb1610-197d-4beb-bca0-f38fdda1136b req-3267c873-3ddb-492c-af9b-feca5efb976f service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 877.299428] env[65080]: INFO networking_nsxv3.common.synchronization [req-2bcb1610-197d-4beb-bca0-f38fdda1136b req-3267c873-3ddb-492c-af9b-feca5efb976f service nova] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 877.299617] env[65080]: INFO networking_nsxv3.common.synchronization [req-2bcb1610-197d-4beb-bca0-f38fdda1136b req-3267c873-3ddb-492c-af9b-feca5efb976f service nova] Enqueued Resource ID: 5b28a506-b09c-4e85-bebb-1863d87be136 with Priority: HIGHEST for action port [ 877.302046] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_rules [ 877.302310] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 877.302527] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b28a506-b09c-4e85-bebb-1863d87be136 with Priority: HIGHEST for action port [ 877.302946] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.303205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.303350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.303622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.303826] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.305235] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.305461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.305765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b28a506-b09c-4e85-bebb-1863d87be136 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.305986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.306140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.306397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.306554] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b28a506-b09c-4e85-bebb-1863d87be136',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.409357] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 877.409460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.409590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.409812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.410037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.410163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.410229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.410387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.410468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.410558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.410648] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.808104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.808248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.808458] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b28a506-b09c-4e85-bebb-1863d87be136 with status ACTIVE [ 877.808631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.808743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.808813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.809041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.809135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.809311] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.809407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.809480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.809637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.809714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.809898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.809990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.810062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.810198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.810264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.810348] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b28a506-b09c-4e85-bebb-1863d87be136 is going to be updated. [ 877.841121] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.841273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.841343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.841550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.841685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.841863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b28a506-b09c-4e85-bebb-1863d87be136" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.912720] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.912928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.912928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.913181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.913367] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.913477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.913542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.913767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.913867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.914175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.914175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.914313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.914313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.914386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.914553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.914651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.914763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.914914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.914995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.915096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.915190] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.032047] env[65080]: INFO networking_nsxv3.common.synchronization [req-2e176cf3-8cbb-4d92-b17f-efa0cb23349d req-7900921d-de40-4870-82bb-bf84eb9e7bcf tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 878.032398] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 878.032938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.033150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.033150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.033341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.033553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.033671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.033733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.033907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.034009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.034120] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.417705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78fc59d1-2dfd-4052-b838-ea0677bb6950: rpc.has_security_group_logging(os_id): False [ 878.437668] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.438644] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.438644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.438978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.438978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.439095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.439095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.439197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.439440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.439440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.440105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.440105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.440269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.440698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.440698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.440698] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be created. [ 878.466691] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.466886] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.467015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.467301] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.467601] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.469593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.469742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.470634] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.470634] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.470634] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.470634] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.470634] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.470824] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.470824] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.470993] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.471068] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.492231] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.492401] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.492577] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.492705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.493037] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9d4e23ad-4436-40c7-9765-ad5af5503ddc taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.493208] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.493324] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.493691] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.493843] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4e23ad-4436-40c7-9765-ad5af5503ddc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.505729] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.505850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.505920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.506137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.506311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.518342] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 878.536285] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.996895] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.997177] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.997284] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.997576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.997727] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.997878] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9d4e23ad-4436-40c7-9765-ad5af5503ddc not found, creating... [ 878.998158] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.998314] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.998427] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.998646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.998787] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.999198] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.999289] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.999366] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.999550] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.999678] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.999813] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9d4e23ad-4436-40c7-9765-ad5af5503ddc is going to be created. [ 879.020572] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.020822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.020896] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.021270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.021599] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.021846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.038698] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.099582] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 879.099787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.099955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.100204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.100390] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.100505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.100570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.100723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.100805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.100905] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.540961] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.541240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.541240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.541418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.541512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.541615] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 879.576156] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.576429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.576429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.576688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.576895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.587508] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 879.603558] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [req-2e176cf3-8cbb-4d92-b17f-efa0cb23349d req-848a2ad6-a836-41b8-8546-0e4b939057d0 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [req-2e176cf3-8cbb-4d92-b17f-efa0cb23349d req-848a2ad6-a836-41b8-8546-0e4b939057d0 service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [req-2e176cf3-8cbb-4d92-b17f-efa0cb23349d req-848a2ad6-a836-41b8-8546-0e4b939057d0 service nova] Enqueued Resource ID: 9d4e23ad-4436-40c7-9765-ad5af5503ddc with Priority: HIGHEST for action port [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 879.749403] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4e23ad-4436-40c7-9765-ad5af5503ddc with Priority: HIGHEST for action port [ 879.749987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.749987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.749987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.750148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.750148] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.751454] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.751675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.752057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4e23ad-4436-40c7-9765-ad5af5503ddc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.752247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.752247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.752615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.752615] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4e23ad-4436-40c7-9765-ad5af5503ddc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.801426] env[65080]: INFO networking_nsxv3.common.synchronization [None req-81265e37-d286-48ce-a4c2-02aa5383e5b8 None None] Enqueued Resource ID: 6a1f556c-6ce6-4bc2-886a-c6543f1b611a with Priority: HIGHEST for action port [ 879.802246] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a1f556c-6ce6-4bc2-886a-c6543f1b611a with Priority: HIGHEST for action port [ 879.802714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a1f556c-6ce6-4bc2-886a-c6543f1b611a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.803103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a1f556c-6ce6-4bc2-886a-c6543f1b611a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.803525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a1f556c-6ce6-4bc2-886a-c6543f1b611a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.804263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a1f556c-6ce6-4bc2-886a-c6543f1b611a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.804530] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a1f556c-6ce6-4bc2-886a-c6543f1b611a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.106561] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.254288] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.254498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.255973] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d4e23ad-4436-40c7-9765-ad5af5503ddc with status ACTIVE [ 880.256193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.256322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.256393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.256598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.256742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.257179] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.257179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.257179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.257428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.257428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.257524] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.257617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.257684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.257837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.257921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.258019] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d4e23ad-4436-40c7-9765-ad5af5503ddc is going to be updated. [ 880.292044] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.292044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.292044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.292495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.292495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.292495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4e23ad-4436-40c7-9765-ad5af5503ddc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.308555] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a1f556c-6ce6-4bc2-886a-c6543f1b611a [ 880.308555] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.308555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.308555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.308555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.308555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.308555] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a1f556c-6ce6-4bc2-886a-c6543f1b611a already deleted. [ 880.308555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a1f556c-6ce6-4bc2-886a-c6543f1b611a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.530786] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 880.531028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.613768] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.614161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.614161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.614251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.614306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.614409] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 880.645605] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.645605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.645605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.645605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.645789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.656091] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 881.035036] env[65080]: INFO networking_nsxv3.common.synchronization [req-42d23e25-0bd6-43cf-a752-5ae3d1e18c10 req-74b1b109-a09a-435f-b1a4-b8644bf49ce5 tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 881.035603] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 881.036246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.036537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.036537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.036742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.036939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.037097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.037203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.037394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.037527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.037660] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.432119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.432119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.432119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.432119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.432119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.432453] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.432698] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.433051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.433307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.433617] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.433851] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.434067] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.434287] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.434493] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.434811] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.435064] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.459287] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.460519] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.460519] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.460519] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.461223] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-5886b78d-ca29-4db2-a1e1-73219e181334 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.461461] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.461607] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.461949] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.462108] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5886b78d-ca29-4db2-a1e1-73219e181334',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.540492] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.597986] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 881.598235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.598866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.599378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.599457] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.599574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.599646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.600103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.600103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.600103] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.855602] env[65080]: INFO networking_nsxv3.common.synchronization [None req-724a63e7-0650-4d23-b775-ad7568e723f8 None None] Enqueued Resource ID: 4616abc7-312e-4bc9-8d04-43f7e39f72db with Priority: HIGHEST for action port [ 881.856256] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4616abc7-312e-4bc9-8d04-43f7e39f72db with Priority: HIGHEST for action port [ 881.856633] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4616abc7-312e-4bc9-8d04-43f7e39f72db taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.856753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4616abc7-312e-4bc9-8d04-43f7e39f72db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.856817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4616abc7-312e-4bc9-8d04-43f7e39f72db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.857568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4616abc7-312e-4bc9-8d04-43f7e39f72db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.857676] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4616abc7-312e-4bc9-8d04-43f7e39f72db',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.968029] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.968029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 5886b78d-ca29-4db2-a1e1-73219e181334 not found, creating... [ 881.968029] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.968029] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.968501] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.968501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.968501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.968501] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 5886b78d-ca29-4db2-a1e1-73219e181334 is going to be created. [ 881.992438] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.992438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.992438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.992438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.992438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.992438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.044689] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.102643] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.360630] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4616abc7-312e-4bc9-8d04-43f7e39f72db [ 882.360877] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.361039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.361116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.361342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.361464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.361569] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4616abc7-312e-4bc9-8d04-43f7e39f72db already deleted. [ 882.361655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4616abc7-312e-4bc9-8d04-43f7e39f72db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.547935] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.548237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.548403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.548770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.548986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.549211] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be updated. [ 882.590939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.591896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.592038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.592295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.592459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.604957] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 882.605213] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.668482] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 882.668482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.668686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.668884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.669150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.669307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.669387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.669579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.669673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.669789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.669892] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.745632] env[65080]: INFO networking_nsxv3.common.synchronization [req-42d23e25-0bd6-43cf-a752-5ae3d1e18c10 req-8fb9cf8a-8ba6-4f5d-a47e-66ba5e4b9ef5 service nova] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_rules [ 882.745937] env[65080]: INFO networking_nsxv3.common.synchronization [req-42d23e25-0bd6-43cf-a752-5ae3d1e18c10 req-8fb9cf8a-8ba6-4f5d-a47e-66ba5e4b9ef5 service nova] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 882.746117] env[65080]: INFO networking_nsxv3.common.synchronization [req-42d23e25-0bd6-43cf-a752-5ae3d1e18c10 req-8fb9cf8a-8ba6-4f5d-a47e-66ba5e4b9ef5 service nova] Enqueued Resource ID: 5886b78d-ca29-4db2-a1e1-73219e181334 with Priority: HIGHEST for action port [ 882.746713] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_rules [ 882.746795] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 882.746891] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5886b78d-ca29-4db2-a1e1-73219e181334 with Priority: HIGHEST for action port [ 882.747297] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.747438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.747505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.747884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.747884] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.748680] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.748791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.748990] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5886b78d-ca29-4db2-a1e1-73219e181334 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.749105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.749191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.749376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.749454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5886b78d-ca29-4db2-a1e1-73219e181334',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.108235] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.109153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.109153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.109153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.109153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.109153] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 883.139559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.139829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.139829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.139973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.140713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.154124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 883.172123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.172422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.172422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.172715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.172914] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.173066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.173191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.173359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.173474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.173601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.173790] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.174369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.174369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.174369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.174556] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.175618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.175618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.175618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.175618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.175618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.175618] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.252980] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.253435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.256725] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5886b78d-ca29-4db2-a1e1-73219e181334 with status ACTIVE [ 883.256725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.256725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.256725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.256725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.256725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.256725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.257143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.257684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.257684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.257789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.258191] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.259540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.259540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.259735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.260161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.260161] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5886b78d-ca29-4db2-a1e1-73219e181334 is going to be updated. [ 883.300106] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.300607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.300607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.300607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.300740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.301025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5886b78d-ca29-4db2-a1e1-73219e181334" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.679653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 379c83f4-3ef4-4263-aff5-1c9a7750a19a: rpc.has_security_group_logging(os_id): False [ 883.700695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.700947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.701046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.702038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.702038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.702038] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.702038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.702038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.702358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.702358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.702682] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.702682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.702822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.703050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.703170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.703415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.703520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.703596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.703762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.703840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.703931] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 883.749325] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.749536] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.749650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.749943] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.750288] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.750741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.750741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.750894] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.751236] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.751307] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.751377] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.751498] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.751645] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.751701] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.751781] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.751924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.773528] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.773803] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.773948] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.774202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-180" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.774559] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-2e08a414-e2c6-4c87-86bb-471e49e857c5 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.774826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.774983] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.775294] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.775440] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e08a414-e2c6-4c87-86bb-471e49e857c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.777660] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.777832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.777910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.778157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.778311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.798834] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 884.282763] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.284277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.284277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.284277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.285266] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.286823] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.286823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.286823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.286823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.286823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.287096] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.287221] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.287425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.287758] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.287982] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.288202] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 is going to be updated. [ 884.313656] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.313905] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.313950] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.314279] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.314851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.314851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.616589] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 884.616818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.617013] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.617234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.617418] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.617558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.617593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.617746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.617830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.617924] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.016570] env[65080]: INFO networking_nsxv3.common.synchronization [req-1f46ff69-ac63-47c8-b560-b9cbffdbd8a0 req-4d5a83d0-470d-494c-aa77-867f41745f5a service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 885.016784] env[65080]: INFO networking_nsxv3.common.synchronization [req-1f46ff69-ac63-47c8-b560-b9cbffdbd8a0 req-4d5a83d0-470d-494c-aa77-867f41745f5a service nova] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 885.017180] env[65080]: INFO networking_nsxv3.common.synchronization [req-1f46ff69-ac63-47c8-b560-b9cbffdbd8a0 req-4d5a83d0-470d-494c-aa77-867f41745f5a service nova] Enqueued Resource ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 with Priority: HIGHEST for action port [ 885.017474] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_rules [ 885.017609] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 885.017708] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 with Priority: HIGHEST for action port [ 885.017981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.020126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.020248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.023596] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.023596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.023596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.023596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.023596] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.024480] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e08a414-e2c6-4c87-86bb-471e49e857c5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.024537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.024598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.024806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.024910] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e08a414-e2c6-4c87-86bb-471e49e857c5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.121453] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.165280] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 885.166206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.166461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.166717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.167576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.167576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.167910] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.526941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.527609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.527609] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.528341] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e08a414-e2c6-4c87-86bb-471e49e857c5 with status ACTIVE [ 885.528481] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.528564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.528622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.528839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.528932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.529120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.529217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.529308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.529454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.529509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.529684] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.529782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.529831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.530012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.530564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.530632] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e08a414-e2c6-4c87-86bb-471e49e857c5 is going to be updated. [ 885.557066] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.558070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.558070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.558070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.558070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.558070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e08a414-e2c6-4c87-86bb-471e49e857c5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.625315] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.672281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.673015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.673015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.673015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.673283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.673283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.673283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.673469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.673617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.673617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.673734] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.673814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.674300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.674300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.674300] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.674599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.674599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.674599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.674802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.674802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.674890] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.822695] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 885.822695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.033852] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.130376] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.130586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.130656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.130912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.130964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.131172] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be updated. [ 886.170896] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.170896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.170896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.171224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.171430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.177509] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354ecbf4-79a8-4770-9da4-7284d1f205e7: rpc.has_security_group_logging(os_id): False [ 886.182065] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 886.198180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.198374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.198478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.198692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.221465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.221741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.222550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.222550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.222550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.222550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.222550] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.222550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.222864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.222864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.222939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.223883] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.223883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.223883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.223883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.223883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.223883] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 886.319274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.319430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.319486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.319683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.319824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.334103] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 886.536214] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.536214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.536728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.536728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.536728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.536728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 886.572024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.572024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.572024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.572024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.572024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.580582] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 886.711017] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d7636ba0-ce81-4092-a8a6-1f1a7b55e5ff None None] Enqueued Resource ID: 64004f33-edda-461d-990b-8e13ab847ec8 with Priority: HIGHEST for action port [ 886.712263] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64004f33-edda-461d-990b-8e13ab847ec8 with Priority: HIGHEST for action port [ 886.712263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-64004f33-edda-461d-990b-8e13ab847ec8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.712263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64004f33-edda-461d-990b-8e13ab847ec8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.712263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64004f33-edda-461d-990b-8e13ab847ec8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.712516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64004f33-edda-461d-990b-8e13ab847ec8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.712516] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64004f33-edda-461d-990b-8e13ab847ec8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.214882] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64004f33-edda-461d-990b-8e13ab847ec8 [ 887.215174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.215317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.215384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.215604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.215693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.215797] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64004f33-edda-461d-990b-8e13ab847ec8 already deleted. [ 887.215891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64004f33-edda-461d-990b-8e13ab847ec8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.594783] env[65080]: INFO networking_nsxv3.common.synchronization [req-849da592-5512-4797-acdd-74e6c778eab1 req-9859ec46-25c3-498a-99b6-8c312684f322 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 887.596240] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 887.596240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.596240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.596240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.597275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.597275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.597275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.597496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.597496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.597581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.597679] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.101523] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.101788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.104470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.104470] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 already deleted. [ 888.104470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.164716] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.165037] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.165222] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.169399] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.169721] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.169906] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.170023] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.170281] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.170437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.170712] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.170771] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.170918] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.170968] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.171093] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.171240] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.171407] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.194060] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 888.194060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.194060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.195373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.196249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.196249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.196249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.196249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.196657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.196657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.196657] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.201167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.201167] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.201167] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.201167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.201167] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-db981f00-ad0d-40db-9a46-b1f9208d0e5b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.201167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.201167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.201167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.201167] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db981f00-ad0d-40db-9a46-b1f9208d0e5b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.353526] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 888.353757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.595469] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 888.595996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.596226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.596460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.596655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.596811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.596862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.597168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.597280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.597432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.598563] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.707527] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.707762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.707762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.707977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.708201] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.708313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.709104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.709104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.709104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.709104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.709104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.709104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.709363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.709363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.710117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.710117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.710117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.710117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.710117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.710117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.710373] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.711429] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.711687] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.711842] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.712091] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.712246] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.712456] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port db981f00-ad0d-40db-9a46-b1f9208d0e5b not found, creating... [ 888.712695] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.712920] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.713082] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.713312] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.713485] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.713791] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.713978] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.714186] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.714376] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.716176] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.716176] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b is going to be created. [ 888.739046] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.739046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.739046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.739046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.739454] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.739454] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.102029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.102029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.102029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.102029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.102402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.102402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.102402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.102523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.102623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.102742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.102920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.103022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.104072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.104072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.104072] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.217311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for defc6278-7bc8-46f9-a983-ce92624f663f: rpc.has_security_group_logging(os_id): False [ 889.240075] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.240075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.240075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.240303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.262409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.262681] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.262866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.262986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.263356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.263356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.263526] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.263689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.263689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.263853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.263931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.264128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.264224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.264285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.264454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.264541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.264631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be updated. [ 889.337974] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.338865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.338865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.338865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.338865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.353785] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 889.497046] env[65080]: INFO networking_nsxv3.common.synchronization [req-849da592-5512-4797-acdd-74e6c778eab1 req-eb97588d-daee-421a-bfb9-5e59ee156d90 service nova] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 889.497232] env[65080]: INFO networking_nsxv3.common.synchronization [req-849da592-5512-4797-acdd-74e6c778eab1 req-eb97588d-daee-421a-bfb9-5e59ee156d90 service nova] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 889.497370] env[65080]: INFO networking_nsxv3.common.synchronization [req-849da592-5512-4797-acdd-74e6c778eab1 req-eb97588d-daee-421a-bfb9-5e59ee156d90 service nova] Enqueued Resource ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b with Priority: HIGHEST for action port [ 889.497920] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 889.500219] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 889.500431] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b with Priority: HIGHEST for action port [ 889.500816] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.503410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.503410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.503410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.503410] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.503410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.504040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.504040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.504102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.504306] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.506806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.506912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.507199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.507345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.507469] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.509159] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-db981f00-ad0d-40db-9a46-b1f9208d0e5b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.509322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.509395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.509592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.509984] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db981f00-ad0d-40db-9a46-b1f9208d0e5b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.607230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05b95378-31e5-4020-807b-04d9b89c292b: rpc.has_security_group_logging(os_id): False [ 889.630352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.630352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.630352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.630352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.651431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.651982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.652346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.652599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.652695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.652883] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.653033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.653107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.653257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.653334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.655164] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 889.732543] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.732745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.732785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.733047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.733210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.751934] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 890.014045] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.014045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.014045] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.015907] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db981f00-ad0d-40db-9a46-b1f9208d0e5b with status ACTIVE [ 890.016212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.016378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.017021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.017021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.017173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.018732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.018732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.018732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.020224] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b is going to be updated. [ 890.045342] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.045342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.045342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.045342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.045342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.045664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.338350] env[65080]: INFO networking_nsxv3.common.synchronization [None req-28499cd4-60a0-4140-9e0f-7abeb6b3791f None None] Enqueued Resource ID: e2ed5a1b-7431-4c37-b9ff-ce30a93915e8 with Priority: HIGHEST for action port [ 890.339595] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ed5a1b-7431-4c37-b9ff-ce30a93915e8 with Priority: HIGHEST for action port [ 890.339595] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2ed5a1b-7431-4c37-b9ff-ce30a93915e8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.339907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2ed5a1b-7431-4c37-b9ff-ce30a93915e8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.340252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2ed5a1b-7431-4c37-b9ff-ce30a93915e8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.340636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2ed5a1b-7431-4c37-b9ff-ce30a93915e8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.340729] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ed5a1b-7431-4c37-b9ff-ce30a93915e8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.523608] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.782222] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9f07463e-cdc1-4ab3-bf07-1fde075ecebb tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 890.782824] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 890.783184] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.783304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.783654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.783654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.783815] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.843722] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2ed5a1b-7431-4c37-b9ff-ce30a93915e8 [ 890.845666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.845666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.845666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.845666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.845666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.845666] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2ed5a1b-7431-4c37-b9ff-ce30a93915e8 already deleted. [ 890.845666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2ed5a1b-7431-4c37-b9ff-ce30a93915e8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.978619] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3d5c48ba-c372-4e39-8909-b6bbacc59988 tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 890.978619] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 890.978619] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.978619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.026931] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.030052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.030052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.030052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.030052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.030052] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be created. [ 891.054244] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.054419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.054460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.055806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.056017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.068212] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: UNINITIALIZED for 2s [ 891.313287] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.313287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.313287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.313287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.313287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.313544] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ac16de-c17b-4005-aa11-407133216460 already deleted. [ 891.313544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.313605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.313947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.313947] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.376915] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 891.377405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.767036] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 891.767191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.839262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.839662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.839662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.839912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.840023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.840144] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ac16de-c17b-4005-aa11-407133216460 already deleted. [ 891.840235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.080090] env[65080]: INFO networking_nsxv3.common.synchronization [None req-4a8b81f4-7d8e-417b-8843-0fc4fd461890 None None] Enqueued Resource ID: a1634941-844c-44b7-8768-2bf872fd1382 with Priority: HIGHEST for action port [ 892.080090] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1634941-844c-44b7-8768-2bf872fd1382 with Priority: HIGHEST for action port [ 892.080519] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1634941-844c-44b7-8768-2bf872fd1382 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.080519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1634941-844c-44b7-8768-2bf872fd1382" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.080519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1634941-844c-44b7-8768-2bf872fd1382" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.081967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1634941-844c-44b7-8768-2bf872fd1382" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.081967] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1634941-844c-44b7-8768-2bf872fd1382',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.583649] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1634941-844c-44b7-8768-2bf872fd1382 [ 892.583888] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.584034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.584109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.584326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.584418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.584519] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1634941-844c-44b7-8768-2bf872fd1382 already deleted. [ 892.584672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1634941-844c-44b7-8768-2bf872fd1382" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.019191] env[65080]: INFO networking_nsxv3.common.synchronization [req-e473168c-0aa2-410d-a918-28b0a0983564 req-131707ec-bb0e-42e5-a7ae-cd9e06509d0a tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 893.019971] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 893.020411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.020579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.020674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.021038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.021396] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.021396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.021536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.021690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.021809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.021942] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.081212] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: SUCCESS [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.081212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.081212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.081568] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.525136] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.525225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.525281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.525498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.525774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.525866] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.525978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.526085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.526296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.526327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.526405] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 already deleted. [ 893.526484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.549156] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.549861] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.550083] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.550441] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.550802] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.551059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.551237] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.551514] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.551796] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.552854] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.552854] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.552854] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.553371] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.553371] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.553371] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.557025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.576460] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.576632] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.576769] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.576948] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.577378] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-7207b88a-d987-4c2a-90ba-4a6e2d30301e taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.577562] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.577681] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.578031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.578224] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7207b88a-d987-4c2a-90ba-4a6e2d30301e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.583857] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.082268] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.082616] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.082719] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.083044] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.083213] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.083420] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 7207b88a-d987-4c2a-90ba-4a6e2d30301e not found, creating... [ 894.083710] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.083873] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.084013] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.084275] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.084420] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.084858] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.085408] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.085408] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.085553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.085633] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.085797] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 7207b88a-d987-4c2a-90ba-4a6e2d30301e is going to be created. [ 894.087236] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fdd5826-7c9a-4cc6-a81b-59df4cf76173: rpc.has_security_group_logging(os_id): False [ 894.110298] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.110298] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.110298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.110875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.110875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.110875] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be created. [ 894.113149] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.113317] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.115967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.115967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.115967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.115967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.219594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.219851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.219973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.220236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.220520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.240761] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: IN_PROGRESS for 2s [ 894.869605] env[65080]: INFO networking_nsxv3.common.synchronization [req-e473168c-0aa2-410d-a918-28b0a0983564 req-9d0ad4e5-8ca7-4a9d-9d2d-c4daccb60b2f service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 894.869784] env[65080]: INFO networking_nsxv3.common.synchronization [req-e473168c-0aa2-410d-a918-28b0a0983564 req-9d0ad4e5-8ca7-4a9d-9d2d-c4daccb60b2f service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 894.869918] env[65080]: INFO networking_nsxv3.common.synchronization [req-e473168c-0aa2-410d-a918-28b0a0983564 req-9d0ad4e5-8ca7-4a9d-9d2d-c4daccb60b2f service nova] Enqueued Resource ID: 7207b88a-d987-4c2a-90ba-4a6e2d30301e with Priority: HIGHEST for action port [ 894.870266] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 894.870390] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 894.870488] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7207b88a-d987-4c2a-90ba-4a6e2d30301e with Priority: HIGHEST for action port [ 894.871934] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.871934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.871934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.871934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.871934] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.876795] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.876957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.877010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.877418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.877418] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.877554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.878284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.878284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.878284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.878284] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.883902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7207b88a-d987-4c2a-90ba-4a6e2d30301e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.883902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.883902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.883902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.883902] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7207b88a-d987-4c2a-90ba-4a6e2d30301e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.033166] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9c7b71cb-778c-4c7d-afc2-513a7f85b988 None None] Enqueued Resource ID: 877fd5b4-9795-4a04-b04f-e4a2d9833386 with Priority: HIGHEST for action port [ 895.033649] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 877fd5b4-9795-4a04-b04f-e4a2d9833386 with Priority: HIGHEST for action port [ 895.033937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-877fd5b4-9795-4a04-b04f-e4a2d9833386 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.034148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-877fd5b4-9795-4a04-b04f-e4a2d9833386" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.034229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-877fd5b4-9795-4a04-b04f-e4a2d9833386" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.034491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-877fd5b4-9795-4a04-b04f-e4a2d9833386" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.034576] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('877fd5b4-9795-4a04-b04f-e4a2d9833386',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.378515] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.378515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.384509] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7207b88a-d987-4c2a-90ba-4a6e2d30301e with status ACTIVE [ 895.384966] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.385367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.386313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.389041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.389041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.389041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.389041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7207b88a-d987-4c2a-90ba-4a6e2d30301e is going to be updated. [ 895.390872] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.428134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.428228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.428262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.428554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.428723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.428894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7207b88a-d987-4c2a-90ba-4a6e2d30301e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.537873] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 877fd5b4-9795-4a04-b04f-e4a2d9833386 [ 895.540164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.540164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.540164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.540164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.540164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.540164] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:877fd5b4-9795-4a04-b04f-e4a2d9833386 already deleted. [ 895.540164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-877fd5b4-9795-4a04-b04f-e4a2d9833386" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.657627] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-87680ba8-ad22-4e08-ae93-d16717f0c20d tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 895.659885] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 895.659885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.659885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.659885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.659885] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.893064] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.012343] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-bc106178-b06a-4e2a-a2cb-623ba0ac4234 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 896.016186] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 896.016891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.018062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.161759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.162160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.162352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.162648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.162859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.163079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.163281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.163429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.163584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.163666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.163772] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 896.194954] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.196205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.196299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.196527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.196816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.207428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 896.253480] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: SUCCESS [ 896.253686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.396169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.396169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.396169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.396678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.396779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.397218] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be created. [ 896.424068] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.424210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.424269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.424523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.424674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.436132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: UNINITIALIZED for 2s [ 896.464311] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.464511] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-370" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.464703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-370" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.465198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-370" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.465592] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.465849] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.466042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.466393] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.466640] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.466968] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.467210] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.467430] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.467517] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.467665] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.467777] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.467908] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.487808] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.487997] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 896.488132] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.488311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-370" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.488629] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.488805] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.488924] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.489303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.489442] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.992395] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.992754] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.992857] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.993214] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.993399] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.993594] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef not found, creating... [ 896.993902] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.994110] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.994241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.994509] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.994646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.994993] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.995228] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.995371] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.995659] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.995823] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.996031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef is going to be created. [ 897.022279] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.022622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.022846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.023148] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.023416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.023705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-2876aa19-c6d0-4fcc-b1ce-62cd36f11fca service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-2876aa19-c6d0-4fcc-b1ce-62cd36f11fca service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-2876aa19-c6d0-4fcc-b1ce-62cd36f11fca service nova] Enqueued Resource ID: 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef with Priority: HIGHEST for action port [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 897.772226] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef with Priority: HIGHEST for action port [ 897.772226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.772226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.772226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.772226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.773257] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.778210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.778210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.778210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.778210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.778210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.778210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.778210] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.222518] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 898.222720] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 deletion is rescheduled due to dependency. [ 898.222850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.223071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.223347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.223558] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.223706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.223803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.224048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.224145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.224248] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.281547] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.281775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.281866] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef with status ACTIVE [ 898.282046] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.282194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.282242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.282437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.282531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.282705] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.282800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.282880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.283074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.283157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.283346] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.283441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.284414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.284414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.284414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.284414] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef is going to be updated. [ 898.288788] env[65080]: INFO networking_nsxv3.common.synchronization [req-955efc6a-ce63-4606-bbc3-0f1ffd11637d req-b8b387c2-aabb-487e-831c-db3a5195bf95 tempest-ServersAdminNegativeTestJSON-1839845653 tempest-ServersAdminNegativeTestJSON-1839845653-project-member] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 898.290044] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 898.290044] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.290267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.290267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.290433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.290603] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.290887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.290965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.291153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.291243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.291342] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.311387] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.311525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.311590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.312050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.312050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.312246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ee4fe4-fb1a-4c7b-ad15-c62b4e1888ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.448264] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 898.448664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.448778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.449021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.449464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.449646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.449853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.450088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.450218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.450462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.450523] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.635075] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.635284] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-537" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.635416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-537" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.635767] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-537" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.636102] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.636275] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.636395] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.636620] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.636765] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.636977] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.637105] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.637298] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.637371] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.637429] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.637532] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.637661] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.652730] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.652945] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.653120] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.653390] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.653649] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.653806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.653921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.654158] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.654297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.654503] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.654681] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.654897] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.655076] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.655244] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.655391] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.655558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.657636] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.657833] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.658029] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.658229] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-537" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.658553] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-7e4c9c5f-8431-4244-a4d8-529b37763f6c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.658755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.658912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.659240] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.659416] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e4c9c5f-8431-4244-a4d8-529b37763f6c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.676729] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.676916] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.677072] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.677308] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.677626] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-4cf87099-3ac4-4713-903f-65a090308736 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.677862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.678035] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.678296] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.678457] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf87099-3ac4-4713-903f-65a090308736',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.726498] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.794720] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.953045] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.953045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.953347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.953347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.953503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.953637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.953711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.953899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.953992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.954095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.954249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.954341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.954404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.954583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.954748] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.954906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.954971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.955090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.955167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.955278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.955375] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.162119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.162437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.162605] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.162913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.163080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.163241] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 7e4c9c5f-8431-4244-a4d8-529b37763f6c not found, creating... [ 899.163501] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.163666] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.163773] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.163999] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.164151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.164432] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.164584] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.164696] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.164934] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.165088] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.165244] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 7e4c9c5f-8431-4244-a4d8-529b37763f6c is going to be created. [ 899.181051] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.181262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.181386] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.181672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.181817] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.182033] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 4cf87099-3ac4-4713-903f-65a090308736 not found, creating... [ 899.182366] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.182557] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.182675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.182906] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.183056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.183340] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.183491] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.183603] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.183810] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.183940] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.184100] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 4cf87099-3ac4-4713-903f-65a090308736 is going to be created. [ 899.186260] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.186447] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.186569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.186785] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.187007] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.187240] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.207470] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.208146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.208146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.208146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.208334] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.208572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.229223] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.296789] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.457676] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 899.481896] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.482232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.482369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.482651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.482791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.483210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.483415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.483526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.483797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.483929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.484489] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.484607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.484672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.484910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.485098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.485372] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.485528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.485630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.485844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.485971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.486120] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be created. [ 899.550552] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.550552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.550552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.550552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.550783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.568385] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 899.732380] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.732615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.732666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.732911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.733016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.733114] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 899.767054] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.767054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.767241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.767563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.767747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.778125] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 899.799810] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.800151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.800151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.800267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.800357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.800458] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be updated. [ 899.841610] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.841779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.841814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.842063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.842230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.851329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 899.932708] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-eda5e5aa-7a4d-4f92-9d24-33d84ff29bd3 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 899.933441] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-eda5e5aa-7a4d-4f92-9d24-33d84ff29bd3 service nova] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 899.933441] env[65080]: INFO networking_nsxv3.common.synchronization [req-6512acb5-e9a3-4eb7-a14c-64dea2bbcf2a req-eda5e5aa-7a4d-4f92-9d24-33d84ff29bd3 service nova] Enqueued Resource ID: 7e4c9c5f-8431-4244-a4d8-529b37763f6c with Priority: HIGHEST for action port [ 899.933983] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_rules [ 899.934118] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 899.934299] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4c9c5f-8431-4244-a4d8-529b37763f6c with Priority: HIGHEST for action port [ 899.934694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.934956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.935287] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.935634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.935938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e4c9c5f-8431-4244-a4d8-529b37763f6c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.935938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.936121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.936917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.936917] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e4c9c5f-8431-4244-a4d8-529b37763f6c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [req-955efc6a-ce63-4606-bbc3-0f1ffd11637d req-814c8003-e12a-43a3-a784-9396f641a855 service nova] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_rules [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [req-955efc6a-ce63-4606-bbc3-0f1ffd11637d req-814c8003-e12a-43a3-a784-9396f641a855 service nova] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [req-955efc6a-ce63-4606-bbc3-0f1ffd11637d req-814c8003-e12a-43a3-a784-9396f641a855 service nova] Enqueued Resource ID: 4cf87099-3ac4-4713-903f-65a090308736 with Priority: HIGHEST for action port [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_rules [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 899.943406] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf87099-3ac4-4713-903f-65a090308736 with Priority: HIGHEST for action port [ 899.943406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.943406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.943406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.943406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.943406] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.943406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.943406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.943406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf87099-3ac4-4713-903f-65a090308736 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.943841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.943841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.943841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.943841] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf87099-3ac4-4713-903f-65a090308736',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.439166] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e4c9c5f-8431-4244-a4d8-529b37763f6c with status ACTIVE [ 900.439457] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.439638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.439695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.440052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.440148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.440398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.440513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.441580] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.441580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.441580] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e4c9c5f-8431-4244-a4d8-529b37763f6c is going to be updated. [ 900.446181] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.446370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.446552] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf87099-3ac4-4713-903f-65a090308736 with status ACTIVE [ 900.446740] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.446852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.446919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.449649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.449649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.450113] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.450297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.450338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.450514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.450606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.450877] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.451109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.452284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.453434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.453434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.453434] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf87099-3ac4-4713-903f-65a090308736 is going to be updated. [ 900.478508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.478586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.479227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.479312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.479421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.480588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e4c9c5f-8431-4244-a4d8-529b37763f6c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.488363] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.489269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.489269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.490350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.490350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.490350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf87099-3ac4-4713-903f-65a090308736" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.854635] env[65080]: INFO networking_nsxv3.common.synchronization [req-4532e5a3-b5c2-4c43-aa7f-eb0ef1617266 req-72e253cf-2631-4b14-8acf-82299a15b3c3 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 900.854635] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 900.856687] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.856687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.856687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.856687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.856687] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.856687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.856919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.856919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.856972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.857076] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.360802] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.582251] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 901.583217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.789677] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 901.789947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.790152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.790379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.790667] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.790750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.790750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.791129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.791129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.791257] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.865691] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 901.866299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.866639] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.867819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.868086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.868282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.868402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.868459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.868619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.868703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.868797] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.296347] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.370435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.370601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.370674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.371187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.371315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.371428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 902.372719] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.405577] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.405870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.405870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.406133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.406196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.418680] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 902.800087] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.875283] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.303059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.303332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.303463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.303775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.303945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.304319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 903.342105] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.342470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.342620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.342929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.343166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.361446] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 903.379040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.379337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.379434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.379683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.380018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.380018] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be updated. [ 903.419591] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.419988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.419988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.420277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.420478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.431697] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 904.431468] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 904.431803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.510285] env[65080]: INFO networking_nsxv3.common.synchronization [req-6dfb7ef6-900d-4093-ba8a-a97c192e0da0 req-006c6969-2829-4bfa-91e8-30d309ebfcb8 tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 904.511530] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 904.512165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.512319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.512433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.512739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.516024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.516024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.516024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.516024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.516024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.516024] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.816872] env[65080]: INFO networking_nsxv3.common.synchronization [req-53dae4db-6740-4349-9cd7-b6646dae9d42 req-40109b73-0b30-4cdc-8eb6-e2ff7cd2ab72 tempest-ServersV294TestFqdnHostnames-1569834486 tempest-ServersV294TestFqdnHostnames-1569834486-project-member] Enqueued Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 904.817443] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26b803-17d9-4a38-b02c-de9324967417 with Priority: HIGHEST for action security_group_members [ 904.817813] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f26b803-17d9-4a38-b02c-de9324967417 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.817952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.819578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.819853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.820079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.820227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.820295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.820464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.820572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.820686] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f26b803-17d9-4a38-b02c-de9324967417',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.950242] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.950242] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.950242] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.950636] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.950919] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.952030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.952030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.952030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.952030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.952253] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.952335] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.952847] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.952847] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.953026] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.953116] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.954118] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.974029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.976736] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.976736] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.976736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.976736] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.976736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.976736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.976736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.976736] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9ba34e4-64e1-45c2-9a1d-cc666c2476bc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.019603] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.019794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.019906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.020625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.020625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.020625] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.020625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.020625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.020828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.020828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.020879] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ac16de-c17b-4005-aa11-407133216460 already deleted. [ 905.020923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.323260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.323454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.323454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.323779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.357825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.358267] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.358449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.358543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.358767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.358897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.358994] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 is going to be updated. [ 905.381715] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 905.381943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.382166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.382403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.382595] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.382726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.382996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.383254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.383351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.383447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.383568] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.384635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.388030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.388030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.388030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.388030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.388030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.388030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.388030] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.404583] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.404788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.404788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.405046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.428538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: IN_PROGRESS for 2s [ 905.445608] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 905.445839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.446047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.446282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.446480] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.446598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.446671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.446825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.446907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.446999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.447117] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.482321] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.482321] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.482321] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.482577] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.482606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.483257] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port b9ba34e4-64e1-45c2-9a1d-cc666c2476bc not found, creating... [ 905.483257] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.483257] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.483463] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.483615] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.483742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.484068] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.485787] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.485787] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.485787] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.485787] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.485787] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: b9ba34e4-64e1-45c2-9a1d-cc666c2476bc is going to be created. [ 905.509109] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.509109] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.509109] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.509109] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.509322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.509493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.888060] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.888310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.888430] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.950519] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.950519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.950519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.950835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.951176] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.951433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.951580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.951899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.952541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.952541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.952710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.952945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.953112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.953414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.953782] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.953969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.954121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.954343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.954487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.954635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.954738] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.313993] env[65080]: INFO networking_nsxv3.common.synchronization [req-6dfb7ef6-900d-4093-ba8a-a97c192e0da0 req-5421355f-f2a9-49e8-81a7-542639e1b59a service nova] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 906.314237] env[65080]: INFO networking_nsxv3.common.synchronization [req-6dfb7ef6-900d-4093-ba8a-a97c192e0da0 req-5421355f-f2a9-49e8-81a7-542639e1b59a service nova] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 906.314445] env[65080]: INFO networking_nsxv3.common.synchronization [req-6dfb7ef6-900d-4093-ba8a-a97c192e0da0 req-5421355f-f2a9-49e8-81a7-542639e1b59a service nova] Enqueued Resource ID: b9ba34e4-64e1-45c2-9a1d-cc666c2476bc with Priority: HIGHEST for action port [ 906.315303] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_rules [ 906.315510] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 906.315753] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ba34e4-64e1-45c2-9a1d-cc666c2476bc with Priority: HIGHEST for action port [ 906.316069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.316230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.316306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.316581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.316681] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.317798] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.317967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.318305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.318522] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.318650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.318888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.318975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.319108] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.319993] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.320121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.320208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.320444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.320584] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9ba34e4-64e1-45c2-9a1d-cc666c2476bc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.391223] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.458105] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78fc59d1-2dfd-4052-b838-ea0677bb6950: rpc.has_security_group_logging(os_id): False [ 906.481061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.481061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.481061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.481061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.481061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.481367] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.481367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.481449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.481585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.481693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.481889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.481989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.482065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.482208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.482314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.482499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.482598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.482659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.482808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.482972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.483039] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be updated. [ 906.555723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.555887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.555986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.556286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.556478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.571394] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 906.822316] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.822484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.822720] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.823847] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9ba34e4-64e1-45c2-9a1d-cc666c2476bc with status ACTIVE [ 906.824096] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.825177] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.825177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.825530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.825530] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.825620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.825878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.825878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.826040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9ba34e4-64e1-45c2-9a1d-cc666c2476bc is going to be updated. [ 906.853557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.853734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.853794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.854878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.854878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.854878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9ba34e4-64e1-45c2-9a1d-cc666c2476bc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.895691] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.896051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.896051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.896360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.896525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.896597] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 906.933017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.933200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.933294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.933504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.933652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944844] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 907.015154] env[65080]: INFO networking_nsxv3.common.synchronization [req-89543ef4-de06-4aed-b7df-5013f4386a8f req-67e8fe02-af55-4e07-be60-1f298a239ad3 tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 907.015473] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 907.015806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.015935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.016029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.016298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.016462] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.016567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.016629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.016787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.016874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.016974] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.330908] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.412847] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.413458] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.413646] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.413989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.414475] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.415150] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.415365] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.415755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.415955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.416203] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.416323] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.416433] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.416540] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.416652] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.416757] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.416915] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.439194] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f26b803-17d9-4a38-b02c-de9324967417 in Status: SUCCESS [ 907.439409] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f26b803-17d9-4a38-b02c-de9324967417 deletion is rescheduled due to dependency. [ 907.439548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f26b803-17d9-4a38-b02c-de9324967417" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.445178] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.445846] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.445846] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.445846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.446132] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-87c29965-c8b8-4e19-ad72-c7e79344b788 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.446348] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.446513] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.446877] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.447101] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87c29965-c8b8-4e19-ad72-c7e79344b788',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.519863] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.520307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.520307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.520590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.520716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.521021] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.521150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.521263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.521427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.521555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.521656] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc already deleted. [ 907.521743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.734590] env[65080]: INFO networking_nsxv3.common.synchronization [req-c9cfe271-a1a1-4432-9cd0-64d517d5dc67 req-b5a0575e-4066-41ad-9e32-7fd8e36275bc tempest-ServersTestJSON-694710217 tempest-ServersTestJSON-694710217-project-member] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 907.735355] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGHEST for action security_group_members [ 907.735497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.735633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.735700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.735908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.736166] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.736277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.736339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.736496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.736583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.736681] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.836711] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.836985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.836985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.837194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.837287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.837391] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ac16de-c17b-4005-aa11-407133216460 is going to be created. [ 907.866598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.866763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.866805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.867016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.867181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.883118] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: UNINITIALIZED for 2s [ 907.950149] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.950547] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.950827] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.951253] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.951520] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.951725] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 87c29965-c8b8-4e19-ad72-c7e79344b788 not found, creating... [ 907.952090] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.952399] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.952640] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.953113] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.953453] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.953866] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.954143] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.954337] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.954666] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.954835] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.955175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 87c29965-c8b8-4e19-ad72-c7e79344b788 is going to be created. [ 907.978296] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.978503] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.978629] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.979141] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.979451] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.979712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.239317] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.239623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.239623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.239847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.269317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.269569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.269688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.269757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.269963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.270065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.270157] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 is going to be updated. [ 908.297314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.297524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.298727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.298921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.299100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.314025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: IN_PROGRESS for 2s [ 908.587686] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 908.587966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.685355] env[65080]: INFO networking_nsxv3.common.synchronization [req-89543ef4-de06-4aed-b7df-5013f4386a8f req-d600426f-c4a4-4162-907a-155a36beaad6 service nova] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_rules [ 908.685544] env[65080]: INFO networking_nsxv3.common.synchronization [req-89543ef4-de06-4aed-b7df-5013f4386a8f req-d600426f-c4a4-4162-907a-155a36beaad6 service nova] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 908.685687] env[65080]: INFO networking_nsxv3.common.synchronization [req-89543ef4-de06-4aed-b7df-5013f4386a8f req-d600426f-c4a4-4162-907a-155a36beaad6 service nova] Enqueued Resource ID: 87c29965-c8b8-4e19-ad72-c7e79344b788 with Priority: HIGHEST for action port [ 908.686290] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_rules [ 908.686407] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 908.686508] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87c29965-c8b8-4e19-ad72-c7e79344b788 with Priority: HIGHEST for action port [ 908.686780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.686903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.686962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.687936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.688039] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.689343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.690249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.691132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.691447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.691715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.691715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.691794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.691930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.692027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.692124] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.693084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-87c29965-c8b8-4e19-ad72-c7e79344b788 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.693084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.693084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.693278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.693309] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87c29965-c8b8-4e19-ad72-c7e79344b788',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.955808] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 908.956125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.956385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.956792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.957175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.957403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.957522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.957795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.957946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.958108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.958378] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.958541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.958653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.958871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.959103] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.959265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.959360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.959593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.959702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.960553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.960553] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.195411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.195597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.195821] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.197499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87c29965-c8b8-4e19-ad72-c7e79344b788 with status ACTIVE [ 909.197499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.197667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.197708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.197917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.198030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.198227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.198324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.198386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.198555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.198615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.198801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.198906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.198957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.199104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.199184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.199258] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87c29965-c8b8-4e19-ad72-c7e79344b788 is going to be updated. [ 909.224719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.225060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.225060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.225206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.225723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.225723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87c29965-c8b8-4e19-ad72-c7e79344b788" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.462338] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c08a0238-d0a8-47ca-b018-8c7d44286412: rpc.has_security_group_logging(os_id): False [ 909.490152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.490345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.490345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.491829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.491829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.491829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.492283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.492376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.492417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.492559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.492698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.492803] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 909.532488] env[65080]: INFO networking_nsxv3.common.synchronization [req-969953fe-74f4-454f-b668-4b90aa134c24 req-f795d1fc-5e51-42b6-bb64-b5475ed20ad1 tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 909.533099] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 909.533413] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.533519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.557474] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.557653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.557785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.558072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.558072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.573461] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 909.702184] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.847987] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.848217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.848342] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.848604] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.848863] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.849031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.849152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.849369] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.849545] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.849752] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.849906] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.849973] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.850100] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.850217] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.850323] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.850453] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.870774] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.870948] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.871086] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.871256] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.871605] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.871815] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.871904] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.872265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.872412] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9447d73f-a9e9-42b5-ac7c-66f7054fb9c3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.893519] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: SUCCESS [ 909.893951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.893951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.894206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.894423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.894544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.894686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.894813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.894941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.895051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.895124] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.204974] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.205220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.205301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.206308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.206419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.206532] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be created. [ 910.230924] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.231085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.231161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.231386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.231550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.240512] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: UNINITIALIZED for 2s [ 910.328171] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 in Status: SUCCESS [ 910.328385] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 deletion is rescheduled due to dependency. [ 910.328526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.378222] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.378492] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.378569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.378849] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.378999] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.379201] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 not found, creating... [ 910.379825] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.380071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.380229] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.380580] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.380867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.381733] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.381733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.381733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.381733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.382031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.382031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 is going to be created. [ 910.398052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.411445] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.411445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.411445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.411445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.411445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.411445] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.904039] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ac16de-c17b-4005-aa11-407133216460: rpc.has_security_group_logging(os_id): False [ 910.927410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.927585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.927642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.927866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.927956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.928268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.928439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.928439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.928604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.928683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.928772] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ac16de-c17b-4005-aa11-407133216460 is going to be created. [ 911.012855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.013030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.013112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.013341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.013523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.025657] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: IN_PROGRESS for 2s [ 911.174531] env[65080]: INFO networking_nsxv3.common.synchronization [req-969953fe-74f4-454f-b668-4b90aa134c24 req-cc8e32dd-3540-43f9-ab4b-262ad3070a2e service nova] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_rules [ 911.175328] env[65080]: INFO networking_nsxv3.common.synchronization [req-969953fe-74f4-454f-b668-4b90aa134c24 req-cc8e32dd-3540-43f9-ab4b-262ad3070a2e service nova] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 911.175439] env[65080]: INFO networking_nsxv3.common.synchronization [req-969953fe-74f4-454f-b668-4b90aa134c24 req-cc8e32dd-3540-43f9-ab4b-262ad3070a2e service nova] Enqueued Resource ID: 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 with Priority: HIGHEST for action port [ 911.176394] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_rules [ 911.176605] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 911.176745] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 with Priority: HIGHEST for action port [ 911.177120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.177253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.177806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.177806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.178100] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.178270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.178396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.178561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.178621] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9447d73f-a9e9-42b5-ac7c-66f7054fb9c3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.593774] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 911.594047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.594318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.594568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.594666] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.681230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 with status ACTIVE [ 911.681454] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.681588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.681711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.681926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.682035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.682226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.682319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.682383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.682547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.682621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.682806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.682899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.682963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.683093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.683161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.683249] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9447d73f-a9e9-42b5-ac7c-66f7054fb9c3 is going to be updated. [ 911.707416] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.707764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.707764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.707924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.708139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.708288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9447d73f-a9e9-42b5-ac7c-66f7054fb9c3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.097819] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.098179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.098179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.098540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.098843] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.098983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.099107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.099349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.099463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.099624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.099773] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.254482] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: UNINITIALIZED for 4s [ 912.602589] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.602846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.602912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.603308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.603509] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.603624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.603689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.603869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.603956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.604105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.604358] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.604558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.604610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.604739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.604893] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.605269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.605269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.605415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.605507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.605600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.605699] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.048028] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: SUCCESS [ 913.048028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.108958] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c08a0238-d0a8-47ca-b018-8c7d44286412: rpc.has_security_group_logging(os_id): False [ 913.137024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.137024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.137024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.137024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.137975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.138721] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.142125] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.142125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.142793] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.142882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.143200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.143339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.143498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.143733] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 913.230901] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.230901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.230901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.231194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.231194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.257091] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 914.037678] env[65080]: INFO networking_nsxv3.common.synchronization [req-9ba26e34-51f2-4577-b30e-90d39c2df624 req-5df2974d-b0ee-40e2-b2a6-0ba61d3c0966 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 914.038107] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 914.038553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.038696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.040514] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.040514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.040514] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.269381] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.269381] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.269381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.269381] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.269916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.270118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.270286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.270398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.270451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.270601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.270682] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.270777] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.384142] env[65080]: INFO networking_nsxv3.common.synchronization [req-9ba26e34-51f2-4577-b30e-90d39c2df624 req-efab95d6-796f-4d60-8e90-6c9ada683909 tempest-ServersTestMultiNic-1588947912 tempest-ServersTestMultiNic-1588947912-project-member] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 914.384696] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGHEST for action security_group_members [ 914.385209] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.385339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.544815] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.774562] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.774562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.774562] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.047260] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.275592] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 915.275923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.276992] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.551063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.551063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.551063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.551063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.551063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.551063] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 915.584681] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.584942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.584942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.585349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.585578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.595697] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 915.756749] env[65080]: INFO networking_nsxv3.common.synchronization [req-b2fc3fd2-c6f7-4ac8-b3e2-d9144d859b2e req-a2008585-ab17-43f0-938c-a810b07a8b8e tempest-ServersTestBootFromVolume-713779798 tempest-ServersTestBootFromVolume-713779798-project-member] Enqueued Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 915.756749] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 with Priority: HIGHEST for action security_group_members [ 915.756901] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-2314d2a9-c4bd-47c8-8042-e43fbe76d252 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.757196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.757294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.757507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.757670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.757774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.757838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.757981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.758074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.758168] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2314d2a9-c4bd-47c8-8042-e43fbe76d252',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.778966] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.779192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.779251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.779424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.779515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.779614] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be updated. [ 915.814999] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.814999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.814999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.814999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.814999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.825943] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 916.262311] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.262311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.262311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.262311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.308712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.308712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.308712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.308712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.308712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.308712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.308712] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 is going to be updated. [ 916.357783] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.358848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.358848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.358848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.358848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.374536] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: IN_PROGRESS for 2s [ 916.542508] env[65080]: INFO networking_nsxv3.common.synchronization [req-922f0f4f-613f-49f2-9199-28c0a5fdcaf5 req-02c8a85d-6c45-4341-94c4-bff15013a997 tempest-ServersAdminNegativeTestJSON-1839845653 tempest-ServersAdminNegativeTestJSON-1839845653-project-member] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 916.543251] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 916.544116] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.544116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.544116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.544656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.544656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.544925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.544925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.545252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.545412] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.545800] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.048399] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.551272] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.614493] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 917.614699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.614977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.615277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.615581] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.615717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.615795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.615977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.616078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.616245] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.881042] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 917.881042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.881042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.881042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.881042] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.881042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.881042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.882158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.882634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.883036] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.059274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.059531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.059634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.059930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.059998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.060418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be updated. [ 918.117511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.117720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.117787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.118047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.118387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.120725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.120725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.120725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.120725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.120990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.121035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.121202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.121302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.121484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.121561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.121670] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be updated. [ 918.138920] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 918.172308] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.173038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.173038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.173038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.173380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.190631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: IN_PROGRESS for 2s [ 918.386649] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.393349] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 in Status: SUCCESS [ 918.393725] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2314d2a9-c4bd-47c8-8042-e43fbe76d252 deletion is rescheduled due to dependency. [ 918.393900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2314d2a9-c4bd-47c8-8042-e43fbe76d252" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.624701] env[65080]: INFO networking_nsxv3.common.synchronization [req-e33bec39-8c6b-4a86-bb99-28353b0bf1f3 req-a47be75b-c2b9-45bd-b0e7-17cf735ecd81 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 918.625936] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 918.626546] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.626831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.627036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.627413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.627693] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.627911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.628082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.628572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.628795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.628992] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.896386] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.131518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.131805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.131805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.131980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.132418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.132650] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.132761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.132827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.134100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.134221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.134368] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 919.170024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.170024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.170024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.170024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.170024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.179765] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 919.399140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.399311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.399627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.399719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.399878] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be updated. [ 919.433730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.437026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.437026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.437026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.437026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.448581] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 920.149272] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 920.149573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.208707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c08a0238-d0a8-47ca-b018-8c7d44286412 in Status: SUCCESS [ 920.208707] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 deletion is rescheduled due to dependency. [ 920.208707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.104100] env[65080]: INFO networking_nsxv3.common.synchronization [req-dc04b14d-d2af-49cb-a633-06efc106b752 req-a54a969e-3c99-4bb6-b6be-5aa22dee2210 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 921.104712] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 921.105283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.106198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.106198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.106198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.106537] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.106687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.106757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.106933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.107107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.107382] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.191963] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 921.192264] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 921.192358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.459661] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 921.459886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.460065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.460283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.460470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.460588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.460653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.460798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.460878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.460963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.461238] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.461352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.461415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.461559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.461703] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.461820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.461887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.462198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.462364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.462486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.462603] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.524600] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.524600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.524600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.524600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.524600] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.524833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.525010] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.525340] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.525561] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.525800] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.525952] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.526381] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.526381] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.526381] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.526550] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.526686] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.548818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.549573] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.549573] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.549573] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.549736] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-a2405478-fbca-4dad-9039-23fa7f9fd423 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.549816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.549861] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.550226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.550365] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2405478-fbca-4dad-9039-23fa7f9fd423',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.610593] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.966687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30779562-35b9-47db-9f9a-0150e8c2a1fc: rpc.has_security_group_logging(os_id): False [ 921.990072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.990072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.990289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.990395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.991035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.991035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.991035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.991035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.991250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.991250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.993140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.993645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.994445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.994445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.994445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.994445] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.994445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.994445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.994972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.994972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.994972] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be created. [ 922.052918] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.053140] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.053837] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.053837] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.053837] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.054087] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port a2405478-fbca-4dad-9039-23fa7f9fd423 not found, creating... [ 922.057922] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.057922] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.057922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.059126] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: a2405478-fbca-4dad-9039-23fa7f9fd423 is going to be created. [ 922.059126] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.059126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.059126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.059126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.059554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.074759] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 922.084569] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.084569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.084569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.084569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.084569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.084569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.112279] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.616520] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.616886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.616886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.616960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.617062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.617163] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 922.648319] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.648516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.648516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.648732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.648880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.658998] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 922.782222] env[65080]: INFO networking_nsxv3.common.synchronization [req-dc04b14d-d2af-49cb-a633-06efc106b752 req-d73676ca-d9e1-48ed-947e-9d8c97330e08 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 922.782493] env[65080]: INFO networking_nsxv3.common.synchronization [req-dc04b14d-d2af-49cb-a633-06efc106b752 req-d73676ca-d9e1-48ed-947e-9d8c97330e08 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 922.782700] env[65080]: INFO networking_nsxv3.common.synchronization [req-dc04b14d-d2af-49cb-a633-06efc106b752 req-d73676ca-d9e1-48ed-947e-9d8c97330e08 service nova] Enqueued Resource ID: a2405478-fbca-4dad-9039-23fa7f9fd423 with Priority: HIGHEST for action port [ 922.783488] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 922.783700] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 922.783857] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2405478-fbca-4dad-9039-23fa7f9fd423 with Priority: HIGHEST for action port [ 922.784226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.784394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.784488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.784701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.784806] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.786208] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.786334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.786548] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2405478-fbca-4dad-9039-23fa7f9fd423 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.786681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.786763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.786962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.787194] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2405478-fbca-4dad-9039-23fa7f9fd423',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.292668] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.292758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.292971] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2405478-fbca-4dad-9039-23fa7f9fd423 with status ACTIVE [ 923.293188] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.293348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.293402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.293572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.293665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.293841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.293971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.294977] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.294977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.294977] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2405478-fbca-4dad-9039-23fa7f9fd423 is going to be updated. [ 923.324517] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.324727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.324770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.324967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.325324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.325530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2405478-fbca-4dad-9039-23fa7f9fd423" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.944878] env[65080]: INFO networking_nsxv3.common.synchronization [None req-68db0d23-9e1f-4ded-adb9-06ef3f676375 None None] Enqueued Resource ID: 5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15 with Priority: HIGHEST for action port [ 923.945590] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15 with Priority: HIGHEST for action port [ 923.945988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.946105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.946198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.946512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.946597] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.088243] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 924.088705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.088705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.088893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.088945] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.226279] env[65080]: INFO networking_nsxv3.common.synchronization [None req-73d7cfba-53c9-461d-a6e0-26d0182e026f tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 924.226847] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 924.229876] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.230109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.230351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.231019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.231120] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.350368] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6e8932c5-f3ee-4294-9d9c-4ec1a20a9c15 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 924.351063] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 924.351871] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.351871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.449272] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15 [ 924.450631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.450631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.450631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.450631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.450631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.450631] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15 already deleted. [ 924.450631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ec1ef7a-a6f1-40d9-8f16-52cd01a06f15" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.591500] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.591669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.591737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.591954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592161] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.592239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.592306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.592462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592736] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.671046] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 924.671046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.671046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.671046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.671046] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.671046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.671046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.671387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.671387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.671463] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.759025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.759025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.759025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.759277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.759277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.760571] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d already deleted. [ 924.760571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.760571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.760571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.760571] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.095114] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.095413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.095413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.095582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.095747] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.095842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.095902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.099911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.099911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.099911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.100384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.100384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.100384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.100384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.100384] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.175072] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.281930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.282196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.282196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.282845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.282845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.282845] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d already deleted. [ 925.282845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.605474] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30779562-35b9-47db-9f9a-0150e8c2a1fc: rpc.has_security_group_logging(os_id): False [ 925.624346] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.624545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.624545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.624762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.624852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.625195] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.625547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.625547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.625646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.625646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.626169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.626169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.626169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.626307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.626307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.626477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.626573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.626644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.626783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.626875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.626961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be updated. [ 925.677705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.697215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.697417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.697487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.697748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.697899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.713938] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 926.180794] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.181104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.181228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.182113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.184274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.184400] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 926.216098] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.216098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.216098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.216098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.216328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.227752] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 926.391739] env[65080]: INFO networking_nsxv3.common.synchronization [None req-0a785250-4e94-4b30-8ca1-54783a13a527 None None] Enqueued Resource ID: 14bd48af-c4c8-41a2-afb5-9d70c1d3bad2 with Priority: HIGHEST for action port [ 926.392105] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14bd48af-c4c8-41a2-afb5-9d70c1d3bad2 with Priority: HIGHEST for action port [ 926.392419] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-14bd48af-c4c8-41a2-afb5-9d70c1d3bad2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.392553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14bd48af-c4c8-41a2-afb5-9d70c1d3bad2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.392623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14bd48af-c4c8-41a2-afb5-9d70c1d3bad2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.392887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14bd48af-c4c8-41a2-afb5-9d70c1d3bad2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.392974] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14bd48af-c4c8-41a2-afb5-9d70c1d3bad2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.894979] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14bd48af-c4c8-41a2-afb5-9d70c1d3bad2 [ 926.896077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.896077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.896077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.896346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.896346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.896346] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14bd48af-c4c8-41a2-afb5-9d70c1d3bad2 already deleted. [ 926.896509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14bd48af-c4c8-41a2-afb5-9d70c1d3bad2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.733452] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 927.733811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.833913] env[65080]: INFO networking_nsxv3.common.synchronization [req-4548fdd8-b457-4471-9d5a-79d6e09035d1 req-5bacbfa3-f390-4f55-9ef6-fcd9f324a697 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 927.834504] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 927.835579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.835579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.835579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.835745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.835913] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.836249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.836249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.836480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.836688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.836862] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.242932] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.242932] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.242932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.242932] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.339101] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.750686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.750686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.750686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.750686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.750686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.751618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.751618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.751618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.751618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.751618] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.843487] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.254880] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 929.275023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.275023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.275023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.275023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.275784] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.278038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.278038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.278038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.278038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.278038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 929.344947] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.345402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.345665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.345846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.345846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.346127] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 929.349933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.349933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.349933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.349933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.349933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.366659] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 929.377906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.378116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.378760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.378760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.378760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.391022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 929.477445] env[65080]: INFO networking_nsxv3.common.synchronization [req-7837135f-aaac-468a-9c43-e67c34b59309 req-0b086fe6-497e-416f-9137-febdf2f4bb19 tempest-ServersNegativeTestJSON-1863572029 tempest-ServersNegativeTestJSON-1863572029-project-member] Enqueued Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 929.477764] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b95378-31e5-4020-807b-04d9b89c292b with Priority: HIGHEST for action security_group_members [ 929.478102] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-05b95378-31e5-4020-807b-04d9b89c292b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.478226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.478292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.478505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.479187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.479187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.479187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.479187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.479658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.479911] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05b95378-31e5-4020-807b-04d9b89c292b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.881874] env[65080]: INFO networking_nsxv3.common.synchronization [req-af0035ff-10d9-4602-aa43-1691c9a066ba req-224e9d15-4867-4bcc-8fe1-1423d881c928 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 929.882421] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 929.883024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.883134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.883192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.883367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.883523] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.883621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.883695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.883853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.884236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.884236] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.982717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.985043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.985043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.985043] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b is going to be updated. [ 930.017582] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.017775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.017861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.018102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.018254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.027623] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: IN_PROGRESS for 2s [ 930.334033] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.334349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.334349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.334760] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.335281] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.335564] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.335717] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.335968] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.336209] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.336434] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.336549] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.336657] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.336765] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.336872] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.336981] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.337162] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.364203] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.364372] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.364520] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.364709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-438" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.365134] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-16794101-dd53-4f56-a4e1-e9187a55f9c8 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.365332] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.365509] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.365876] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.366116] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16794101-dd53-4f56-a4e1-e9187a55f9c8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.386654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.386654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.386654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.387019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.387138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.387422] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.387545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.387614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.387752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.387827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.387915] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 930.422945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.423226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.423307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.423555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.423757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.455936] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 930.868749] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.869566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.869566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.869678] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.869920] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.869996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 16794101-dd53-4f56-a4e1-e9187a55f9c8 not found, creating... [ 930.870215] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.870379] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.870494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.870707] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.870849] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.871310] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.871423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.871470] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.872055] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.872720] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.873284] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 16794101-dd53-4f56-a4e1-e9187a55f9c8 is going to be created. [ 930.893217] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.893487] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.893556] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.893811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.894046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.894268] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.389180] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 931.389516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.403374] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 931.403624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.649088] env[65080]: INFO networking_nsxv3.common.synchronization [req-af0035ff-10d9-4602-aa43-1691c9a066ba req-2344dc6b-94e2-44ef-ac51-ede86649dd5d service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 931.649553] env[65080]: INFO networking_nsxv3.common.synchronization [req-af0035ff-10d9-4602-aa43-1691c9a066ba req-2344dc6b-94e2-44ef-ac51-ede86649dd5d service nova] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 931.649553] env[65080]: INFO networking_nsxv3.common.synchronization [req-af0035ff-10d9-4602-aa43-1691c9a066ba req-2344dc6b-94e2-44ef-ac51-ede86649dd5d service nova] Enqueued Resource ID: 16794101-dd53-4f56-a4e1-e9187a55f9c8 with Priority: HIGHEST for action port [ 931.651572] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_rules [ 931.651572] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 931.651572] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16794101-dd53-4f56-a4e1-e9187a55f9c8 with Priority: HIGHEST for action port [ 931.651572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.651572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.651572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.651572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.651572] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.652189] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.652189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.652189] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-16794101-dd53-4f56-a4e1-e9187a55f9c8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.652314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.652350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.653344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.653344] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16794101-dd53-4f56-a4e1-e9187a55f9c8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.038587] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05b95378-31e5-4020-807b-04d9b89c292b in Status: SUCCESS [ 932.038867] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05b95378-31e5-4020-807b-04d9b89c292b deletion is rescheduled due to dependency. [ 932.038991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05b95378-31e5-4020-807b-04d9b89c292b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.157865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.158223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.161088] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16794101-dd53-4f56-a4e1-e9187a55f9c8 with status ACTIVE [ 932.161088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.161088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.161088] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.161088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.161088] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16794101-dd53-4f56-a4e1-e9187a55f9c8 is going to be updated. [ 932.191651] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.191834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.191875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.192190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.192346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.192859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16794101-dd53-4f56-a4e1-e9187a55f9c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.471266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 932.472232] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 932.472232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.472232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.472232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.472520] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.472520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.472520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.472698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.472698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.472804] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.975351] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.324176] env[65080]: INFO networking_nsxv3.common.synchronization [None req-cb8b0641-7bd3-4385-908e-d878b06e2ff4 None None] Enqueued Resource ID: 4eb0c19f-b420-4699-8f7b-cd3595885310 with Priority: HIGHEST for action port [ 933.324942] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb0c19f-b420-4699-8f7b-cd3595885310 with Priority: HIGHEST for action port [ 933.326351] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb0c19f-b420-4699-8f7b-cd3595885310 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.326527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb0c19f-b420-4699-8f7b-cd3595885310" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.326588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb0c19f-b420-4699-8f7b-cd3595885310" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.327093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb0c19f-b420-4699-8f7b-cd3595885310" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.327093] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb0c19f-b420-4699-8f7b-cd3595885310',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.477975] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.829639] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eb0c19f-b420-4699-8f7b-cd3595885310 [ 933.829872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.830014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.830086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.830301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.830393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.830489] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eb0c19f-b420-4699-8f7b-cd3595885310 already deleted. [ 933.830569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb0c19f-b420-4699-8f7b-cd3595885310" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.981251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.981409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.981504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.981706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.982454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.982454] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 934.015666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.017162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.017336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.017614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.017806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.026933] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 934.297327] env[65080]: INFO networking_nsxv3.common.synchronization [req-c6d9e5e4-9aaf-4288-9968-52e6893b99e4 req-a173f4c2-92ff-45fa-b36d-9112817b82eb tempest-ServersAdminNegativeTestJSON-1839845653 tempest-ServersAdminNegativeTestJSON-1839845653-project-member] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 934.298253] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGHEST for action security_group_members [ 934.299142] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.299316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.299408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.300033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.300268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.300411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.300497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.300703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.300859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.300966] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.602037] env[65080]: INFO networking_nsxv3.common.synchronization [req-6c3a0d95-ac9e-457f-83ef-bafd7c4dc911 req-eaa97246-b539-47d7-9396-2e5defa1818c tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 934.602521] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 934.602830] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.602956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.603126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.603413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.603494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.603598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.603660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.603816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.603903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.603998] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.808908] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.810379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.810379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.810379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.812037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.812037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.812037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.812037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.812037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.812037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.812037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be updated. [ 934.842755] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.842943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.843042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.843284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.843510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.848251] env[65080]: INFO networking_nsxv3.common.synchronization [req-cb2c220d-eaf5-4c42-bad1-74ed044dd47b req-54d0a33a-0625-47ed-a962-51cc789c0390 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 934.848811] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 934.849160] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.849286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.849367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.849574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.849782] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.849870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.850146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.850146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.850244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.850347] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.857604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: IN_PROGRESS for 2s [ 935.107026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.107144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.107211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.107435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.128141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.129061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.129061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.129061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.129061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.129061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.129061] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 935.156401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.157093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.157093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.157093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.157093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.169822] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 935.355169] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.857409] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.966565] env[65080]: INFO networking_nsxv3.common.synchronization [None req-d5cd75c8-937d-43c9-991b-b5c8f909da15 None None] Enqueued Resource ID: 26b5b4cc-2625-4b7e-bd20-49f3018734a0 with Priority: HIGHEST for action port [ 935.967547] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26b5b4cc-2625-4b7e-bd20-49f3018734a0 with Priority: HIGHEST for action port [ 935.967547] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-26b5b4cc-2625-4b7e-bd20-49f3018734a0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.967547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26b5b4cc-2625-4b7e-bd20-49f3018734a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.967547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26b5b4cc-2625-4b7e-bd20-49f3018734a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.967831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26b5b4cc-2625-4b7e-bd20-49f3018734a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.968025] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26b5b4cc-2625-4b7e-bd20-49f3018734a0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.038851] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 936.039091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.039259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.039493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.039689] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.039810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.039905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.040078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.040155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.040237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.040325] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.359026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.359209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.359268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.359482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.359574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.359915] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 936.395692] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.395847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.395919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.396168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.396322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.406908] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 936.471941] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26b5b4cc-2625-4b7e-bd20-49f3018734a0 [ 936.471941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.471941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.472119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.472273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.472316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.472388] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26b5b4cc-2625-4b7e-bd20-49f3018734a0 already deleted. [ 936.472472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26b5b4cc-2625-4b7e-bd20-49f3018734a0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.543959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.544148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.545275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.545275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.545275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.546357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.546357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.546678] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.867918] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 in Status: SUCCESS [ 936.868256] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 deletion is rescheduled due to dependency. [ 936.868256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.050086] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354ecbf4-79a8-4770-9da4-7284d1f205e7: rpc.has_security_group_logging(os_id): False [ 937.069937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.070152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.070248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.070511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.070625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.070871] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.070993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.071085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.071272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.071362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.071564] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.071677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.071774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.071894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.071987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.073250] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.073250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.073250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.073250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.073250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.073250] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 937.137124] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.137297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.137339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.137685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.137858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.159508] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 937.181451] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 937.181843] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf deletion is rescheduled due to dependency. [ 937.182063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.063629] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6b6549c4-f255-4134-8be9-089b3a0346b0 None None] Enqueued Resource ID: 04c0e82e-48a3-4fcf-9a20-061e000be5d5 with Priority: HIGHEST for action port [ 938.064377] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04c0e82e-48a3-4fcf-9a20-061e000be5d5 with Priority: HIGHEST for action port [ 938.064377] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-04c0e82e-48a3-4fcf-9a20-061e000be5d5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.064377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04c0e82e-48a3-4fcf-9a20-061e000be5d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.064377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04c0e82e-48a3-4fcf-9a20-061e000be5d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.064807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04c0e82e-48a3-4fcf-9a20-061e000be5d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.064807] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04c0e82e-48a3-4fcf-9a20-061e000be5d5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.419691] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 938.419691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.567545] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04c0e82e-48a3-4fcf-9a20-061e000be5d5 [ 938.567851] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.568658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.568658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.568658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.568658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.568658] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04c0e82e-48a3-4fcf-9a20-061e000be5d5 already deleted. [ 938.568658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04c0e82e-48a3-4fcf-9a20-061e000be5d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.179428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 939.179720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.753184] env[65080]: INFO networking_nsxv3.common.synchronization [req-ed86e289-f521-44c4-8810-460e281d3e95 req-467a0a0c-70f4-45d2-870e-c7ddb0865dd8 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 939.753619] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 939.753956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.754182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.754310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.754619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.754792] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.754901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.754966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.755280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.755442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.755557] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.188538] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.189391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.191020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.191020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.191020] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.191020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.191020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.191348] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.191588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.191905] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.192137] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.192384] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.192611] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.192822] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.193035] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.193338] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.215955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.215955] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.215955] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.215955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.215955] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.216302] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.216302] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.216550] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.216687] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ffbdbe-3c0e-477f-9a93-d8afc56ff153',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.262315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.262593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.262668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.262902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.262992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.263202] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.263301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.263361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.263520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.263606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.263692] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d already deleted. [ 940.263772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.720712] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.720984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.721167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.721474] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.721647] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.721802] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 not found, creating... [ 940.722083] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.722247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.722437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.722682] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.722839] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.723171] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.723349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.723475] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.723681] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.723839] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.723945] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 is going to be created. [ 940.743795] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.744016] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.744151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.744428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.744658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.744865] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.945309] env[65080]: INFO networking_nsxv3.common.synchronization [None req-de16d9ab-ab81-42ae-8c51-aa584e344e5a None None] Enqueued Resource ID: 89bcab4b-541a-4753-bd6b-8aff0a2971b2 with Priority: HIGHEST for action port [ 940.945567] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89bcab4b-541a-4753-bd6b-8aff0a2971b2 with Priority: HIGHEST for action port [ 940.946185] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-89bcab4b-541a-4753-bd6b-8aff0a2971b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.946353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89bcab4b-541a-4753-bd6b-8aff0a2971b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.946392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89bcab4b-541a-4753-bd6b-8aff0a2971b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.947709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89bcab4b-541a-4753-bd6b-8aff0a2971b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.947709] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bcab4b-541a-4753-bd6b-8aff0a2971b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.450951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89bcab4b-541a-4753-bd6b-8aff0a2971b2 [ 941.450951] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.450951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.450951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.450951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.450951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.450951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89bcab4b-541a-4753-bd6b-8aff0a2971b2 already deleted. [ 941.450951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89bcab4b-541a-4753-bd6b-8aff0a2971b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.481745] env[65080]: INFO networking_nsxv3.common.synchronization [req-ed86e289-f521-44c4-8810-460e281d3e95 req-82eaaa98-0531-478a-9c01-a5d8fb603fd3 service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 941.481745] env[65080]: INFO networking_nsxv3.common.synchronization [req-ed86e289-f521-44c4-8810-460e281d3e95 req-82eaaa98-0531-478a-9c01-a5d8fb603fd3 service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 941.481745] env[65080]: INFO networking_nsxv3.common.synchronization [req-ed86e289-f521-44c4-8810-460e281d3e95 req-82eaaa98-0531-478a-9c01-a5d8fb603fd3 service nova] Enqueued Resource ID: e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 with Priority: HIGHEST for action port [ 941.483863] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 941.483863] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 941.483863] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 with Priority: HIGHEST for action port [ 941.483863] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.485224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.485224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.485224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.485224] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.486079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.486290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.486290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.487173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.487173] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.487173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.487173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.487173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.487406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.487406] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.492447] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.493084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.493084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.493084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.493084] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9ffbdbe-3c0e-477f-9a93-d8afc56ff153',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.994809] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.996260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.996395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.996875] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 with status ACTIVE [ 941.997056] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.997177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.997246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.997557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.997660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.997986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.997986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.997986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.998274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.998383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.998636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.998732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.998798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.998940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.999026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.999110] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9ffbdbe-3c0e-477f-9a93-d8afc56ff153 is going to be updated. [ 942.021494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.021643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.021713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.021934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.022076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.022290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9ffbdbe-3c0e-477f-9a93-d8afc56ff153" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.501715] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.005263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.005263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.005263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.005602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.005602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.005705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be created. [ 943.030527] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.030738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.030738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.030924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.031094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.041852] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: UNINITIALIZED for 2s [ 943.640613] env[65080]: INFO networking_nsxv3.common.synchronization [req-69404596-aeb9-4021-8cbf-bdf999db90b4 req-e15a9fe0-641b-4bc2-b5dc-305b63dba66f tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 943.642274] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 943.642274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.642274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.642274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.642879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.642879] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.144186] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.646481] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.057398] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.057398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.057398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.058659] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.150104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.150329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.150440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.151167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.151317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.151465] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 945.192565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.192783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.192882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.193223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.193435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.206199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 945.560756] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.061809] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf55eea-7c35-4863-963a-9034c2b5fa2d: rpc.has_security_group_logging(os_id): False [ 946.080919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.081072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.081145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.081362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.081447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.081678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.081803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.081862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.081969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.082053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.082136] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be created. [ 946.154617] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.154834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.154926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.155218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.155437] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.168956] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 947.220530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 947.221110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.186028] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 948.186028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.642079] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 948.642366] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 949.824366] env[65080]: INFO networking_nsxv3.common.synchronization [req-3e20d55a-5c48-4139-b3ac-30d5a7162eb7 req-036a9aeb-c944-485e-aa2e-161b24a34945 tempest-ServersWithSpecificFlavorTestJSON-1451435589 tempest-ServersWithSpecificFlavorTestJSON-1451435589-project-member] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 949.824366] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGHEST for action security_group_members [ 949.824366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.824366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.824366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.824801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.824801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.824801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.824944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.825383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.825383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.825383] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.330037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.330037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.330037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.330037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.338016] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b6072dd3-dba5-4842-a5a8-11ad51a7f720 tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 950.338016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 950.338585] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.339741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.339741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.339741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.339741] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.353807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.353807] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.353807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.353807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.353807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.353807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.353807] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be updated. [ 950.383887] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.384036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.384109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.384315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.384461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.400045] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: IN_PROGRESS for 2s [ 950.446761] env[65080]: INFO networking_nsxv3.common.synchronization [None req-ce289f84-99ea-498c-8310-33b7ddc6ec1c tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 950.447421] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 950.447801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.447874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862216] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.862524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.862762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.862762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.862870] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e already deleted. [ 950.862913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.863158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.863338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.863426] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.386460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.386630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.386700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.386927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.387029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.387123] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e already deleted. [ 951.387205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.412078] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 in Status: SUCCESS [ 952.412363] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 deletion is rescheduled due to dependency. [ 952.412363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.483688] env[65080]: INFO networking_nsxv3.common.synchronization [req-970e7e2a-a633-4ddf-8aaf-b10dbff57651 req-bf96a305-918d-45e7-9649-53b589c6ba97 tempest-ImagesTestJSON-248791707 tempest-ImagesTestJSON-248791707-project-member] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 953.483984] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGHEST for action security_group_members [ 953.484337] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.484482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.484565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.484769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.484925] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.485044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.485111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.485291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.485374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.485471] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.990184] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.990351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.990424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.990652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.990747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.990951] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.991074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.991133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.991281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.991358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.991469] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be updated. [ 954.016944] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.017116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.017159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.017367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.017505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.026221] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: IN_PROGRESS for 2s [ 954.110376] env[65080]: INFO networking_nsxv3.common.synchronization [req-629e5480-b43d-4e87-a9a1-8a9f79144c55 req-fc672423-d258-4bc6-8b41-285b656c41ef tempest-ServerGroupTestJSON-603688985 tempest-ServerGroupTestJSON-603688985-project-member] Enqueued Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 954.111266] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 954.111575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.111712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.111769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.112016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.112194] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.112307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.112373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.112538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.112624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.112717] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.456513] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.456773] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-587" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.456943] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-587" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.457406] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-587" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.457744] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.457966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.458159] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.458959] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.459155] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.459403] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.459572] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.459733] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.459895] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.460071] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.460229] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.460425] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.481744] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.481744] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.481744] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.482033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-587" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.482240] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-64859dfa-8528-4b61-8a43-3a0575fc3b46 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.482416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.482560] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.482869] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.483266] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64859dfa-8528-4b61-8a43-3a0575fc3b46',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.614397] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.614726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.614726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.614930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.615078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.615411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.615592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.615592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.615701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.615813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.615960] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f already deleted. [ 954.615960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985022] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.985307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.985459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.985732] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.985874] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.986065] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 64859dfa-8528-4b61-8a43-3a0575fc3b46 not found, creating... [ 954.986634] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.986831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.986949] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.987198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.987350] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.987647] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.987802] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.987918] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.988140] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.988273] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.988414] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 64859dfa-8528-4b61-8a43-3a0575fc3b46 is going to be created. [ 955.011106] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.011338] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.011512] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.011855] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.012100] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.012331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.611313] env[65080]: INFO networking_nsxv3.common.synchronization [req-2749f4cb-2f1a-4192-80f0-a38eea922f05 req-8006b782-a6ba-46a3-a4a1-c4d680ab110b tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 955.611873] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 955.612199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.612330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.612399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.612775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.612978] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.613332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.613490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.613780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.614046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.614046] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.737377] env[65080]: INFO networking_nsxv3.common.synchronization [req-629e5480-b43d-4e87-a9a1-8a9f79144c55 req-a5692b2d-6bcc-4090-980f-48dc9057ae61 service nova] Enqueued Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_rules [ 955.737753] env[65080]: INFO networking_nsxv3.common.synchronization [req-629e5480-b43d-4e87-a9a1-8a9f79144c55 req-a5692b2d-6bcc-4090-980f-48dc9057ae61 service nova] Enqueued Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 955.737753] env[65080]: INFO networking_nsxv3.common.synchronization [req-629e5480-b43d-4e87-a9a1-8a9f79144c55 req-a5692b2d-6bcc-4090-980f-48dc9057ae61 service nova] Enqueued Resource ID: 64859dfa-8528-4b61-8a43-3a0575fc3b46 with Priority: HIGHEST for action port [ 955.738355] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_rules [ 955.738592] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 955.738799] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64859dfa-8528-4b61-8a43-3a0575fc3b46 with Priority: HIGHEST for action port [ 955.739231] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.739427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.739532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.739906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.740094] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.741726] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.741898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.742018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.743137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.743421] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.743607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.743721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.744010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.744149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.744259] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.745506] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-64859dfa-8528-4b61-8a43-3a0575fc3b46 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.745506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.745506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.746353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.746485] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64859dfa-8528-4b61-8a43-3a0575fc3b46',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.957884] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.958132] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.958301] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.958672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.958959] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.959138] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.959262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.959507] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.959661] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.959979] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.960115] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.960225] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.960351] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.960438] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.960543] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.960684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.979283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.979405] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.979529] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.979701] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.980017] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.980190] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.980300] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.980617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.980758] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e69f97c-6031-46be-9ee1-ba6f748e0ed8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.035086] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 in Status: SUCCESS [ 956.035366] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 deletion is rescheduled due to dependency. [ 956.035538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.116588] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.116879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.116879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.117456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.117611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.117839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.118181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.118181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.118326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.118326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.118435] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d already deleted. [ 956.118435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.248574] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64859dfa-8528-4b61-8a43-3a0575fc3b46 with status ACTIVE [ 956.248815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.249058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.249058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.249269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.249378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.249610] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.249715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.249781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.249933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.250015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.250292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.250392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.250453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.250593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.250669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.250754] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64859dfa-8528-4b61-8a43-3a0575fc3b46 is going to be updated. [ 956.252567] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.252722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.252865] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.275714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.275945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.275945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.276192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.276511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.276752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64859dfa-8528-4b61-8a43-3a0575fc3b46" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.483933] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.483933] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.483933] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.484401] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.484492] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.484655] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 not found, creating... [ 956.484932] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.485090] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.485205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.485459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.485598] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.485872] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.486034] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.486556] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.486556] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.486556] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486703] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 is going to be created. [ 956.518276] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.518523] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.518658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.519032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.519326] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.519554] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.563473] env[65080]: INFO networking_nsxv3.common.synchronization [req-12032053-c6ef-429a-9ae2-3484f66ed5cd req-c3a1e634-6038-4926-aa35-6ade193bc0a2 tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 956.564037] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 956.564360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.564491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.564558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.564800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.564956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.565078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.565191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.565400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.565488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.565585] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.755055] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.067525] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.248547] env[65080]: INFO networking_nsxv3.common.synchronization [req-2749f4cb-2f1a-4192-80f0-a38eea922f05 req-e95c0439-7ff8-4d56-acc0-94a51ef7af59 service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 957.248853] env[65080]: INFO networking_nsxv3.common.synchronization [req-2749f4cb-2f1a-4192-80f0-a38eea922f05 req-e95c0439-7ff8-4d56-acc0-94a51ef7af59 service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 957.249053] env[65080]: INFO networking_nsxv3.common.synchronization [req-2749f4cb-2f1a-4192-80f0-a38eea922f05 req-e95c0439-7ff8-4d56-acc0-94a51ef7af59 service nova] Enqueued Resource ID: 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 with Priority: HIGHEST for action port [ 957.249285] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 957.249420] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 957.249533] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 with Priority: HIGHEST for action port [ 957.250123] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.250247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.250338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.250564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.250649] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.251779] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.251918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.251948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.252339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.252339] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.252339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.252444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.252546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.252628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.252720] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.253918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.253918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.253918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.253918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.253918] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e69f97c-6031-46be-9ee1-ba6f748e0ed8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.257296] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.257427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.257515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.257702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.257785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.257882] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f is going to be created. [ 957.283426] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.283664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.283664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.283794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.283940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.294902] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: UNINITIALIZED for 2s [ 957.572597] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.755774] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.757242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.757527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 with status ACTIVE [ 957.757683] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.757892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.758113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.758201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.759023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.759023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.759023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.759023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.759023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.759232] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.759232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.759232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.759343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.759595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.759595] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e69f97c-6031-46be-9ee1-ba6f748e0ed8 is going to be updated. [ 957.780715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.780911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.781182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.781221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.781344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.781502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e69f97c-6031-46be-9ee1-ba6f748e0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.075453] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.075453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.075453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.075651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.076122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.076122] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be updated. [ 958.108559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.108710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.108782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.108974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.109139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.118499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 958.261932] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.763471] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.763789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.763875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.764106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.764201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.764303] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be created. [ 958.790704] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.790874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.790919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.791133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.791293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.800857] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: UNINITIALIZED for 2s [ 959.312648] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: SUCCESS [ 959.313031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.313317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.313618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.313911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.314123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.314261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.314584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.314718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.314894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.315158] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.818770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.818770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.819085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.819085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.819222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.819342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.819393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.819525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.819617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.819709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.819859] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.820185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.820185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.820185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.820301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.820398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.820459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.820596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.820671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.820753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.820845] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.843143] env[65080]: INFO networking_nsxv3.common.synchronization [req-178e7d7a-6073-4f15-b896-ac8e290eafbe req-af9ce12c-be2d-485f-8fb6-a51502f4d300 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 959.844127] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 959.844555] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.844732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.844834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.845370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.845370] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.845551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.845606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.845839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.845975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.846136] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.971322] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a644348-746a-4366-93c3-ee68552a3e38 req-76d50874-c621-482a-ada3-89effd83a569 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 959.972026] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 959.972109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.972921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.972921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.972921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.972921] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.972921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.972921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.973201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.973201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.973317] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.129582] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 960.129582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.325860] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f: rpc.has_security_group_logging(os_id): False [ 960.345384] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.345586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.345689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.345979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.346115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.347841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.347841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.347841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.347841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.348390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.348390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.348390] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f is going to be created. [ 960.349389] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.375577] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.375961] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.376070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.376341] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.376598] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.376759] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.376901] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.377144] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.377291] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.377502] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.377614] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.377719] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.377824] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.377932] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.378046] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.378177] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.397772] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.397772] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.397941] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.398087] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.398415] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-5f40f5b3-ab85-4f33-9eb4-0145072870b2 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.398588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.398705] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.399044] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.399226] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f40f5b3-ab85-4f33-9eb4-0145072870b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.416376] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.416581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.416673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.416910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.417159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.428069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: IN_PROGRESS for 2s [ 960.475744] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.476022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.476157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.476447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.476538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.476753] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.476911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.476999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.477234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.477324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.477413] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e already deleted. [ 960.477500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.812044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 960.812252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.812421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.812641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.812888] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.813023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.813090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.813312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.813445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.813583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.813732] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.852612] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.902812] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.902812] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.902812] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.903117] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.903218] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.903340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 5f40f5b3-ab85-4f33-9eb4-0145072870b2 not found, creating... [ 960.903826] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.903826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.903927] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.904298] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.904457] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.904757] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.904918] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.905115] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.905511] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.905715] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.905892] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 5f40f5b3-ab85-4f33-9eb4-0145072870b2 is going to be created. [ 960.928379] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.928606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.928709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.929122] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.929480] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.929814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.316305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.316483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.316526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.316749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.316928] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.317052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.317119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.317284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.317376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.317507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.317641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.317767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.317799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.317932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.318125] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.318173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.318228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.318369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.318439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.318524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.318619] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.355604] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.355796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.355874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.356238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.356351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.356477] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 961.392062] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.392062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.392062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.392425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.392425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.401217] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 961.685348] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a644348-746a-4366-93c3-ee68552a3e38 req-5c6ad0f9-acf4-4e31-802f-f0df8b46b6a5 service nova] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_rules [ 961.685469] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a644348-746a-4366-93c3-ee68552a3e38 req-5c6ad0f9-acf4-4e31-802f-f0df8b46b6a5 service nova] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 961.685605] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a644348-746a-4366-93c3-ee68552a3e38 req-5c6ad0f9-acf4-4e31-802f-f0df8b46b6a5 service nova] Enqueued Resource ID: 5f40f5b3-ab85-4f33-9eb4-0145072870b2 with Priority: HIGHEST for action port [ 961.686123] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_rules [ 961.686266] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 961.686380] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f40f5b3-ab85-4f33-9eb4-0145072870b2 with Priority: HIGHEST for action port [ 961.686715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.686797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.686844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.687096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.687195] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.687995] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.688124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.688189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.688362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.688508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.688602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.688662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.688794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.688878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.688966] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.689685] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f40f5b3-ab85-4f33-9eb4-0145072870b2 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.689801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.689855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.690199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.690199] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f40f5b3-ab85-4f33-9eb4-0145072870b2',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.822568] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d: rpc.has_security_group_logging(os_id): False [ 961.843524] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.843688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.843738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.843960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.844070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.844271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.844371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.844435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.844593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.844664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.844950] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.845141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.845250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.845557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.845664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.845869] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.845967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.846042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.846185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.846283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.846393] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be created. [ 961.915267] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.915852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.915852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.915852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.915980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.932810] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 962.193839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.193958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.194300] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.195459] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f40f5b3-ab85-4f33-9eb4-0145072870b2 with status ACTIVE [ 962.195595] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.195732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.195797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.196061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.196158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.196388] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.196527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.196570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.196728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.196805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.197026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.197128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.197191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.197355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.197434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.197521] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f40f5b3-ab85-4f33-9eb4-0145072870b2 is going to be updated. [ 962.226537] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.227138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.227138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.227138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.227138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.227482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f40f5b3-ab85-4f33-9eb4-0145072870b2" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.451642] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: SUCCESS [ 962.451642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.561026] env[65080]: INFO networking_nsxv3.common.synchronization [req-388f9f93-cecd-4acf-9e07-d0e6892a966a req-5c05d8b4-553a-40cd-a692-8eb9925c6cb2 tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 962.561613] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 962.562158] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.562158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.562369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.562426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.562669] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.562804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.562882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.563197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.563197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.563363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.700037] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.906080] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.906080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.906357] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.906915] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.906915] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.906915] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.907172] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.907252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.907875] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.908130] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.908254] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.908364] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.908740] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.908740] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.908917] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.908986] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.943488] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.943910] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.943910] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.943996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.944357] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.944625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.944625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.945051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.945203] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.065254] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.065580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.065646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.065890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.065984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.066258] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.066391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.066460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.066665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.066713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.066784] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 963.096641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.096846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.096846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.097193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.097284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.107684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 963.203459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.203459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.203459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.203459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.203459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.203795] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be created. [ 963.228760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.228925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.229065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.229212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.229425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.238701] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: UNINITIALIZED for 2s [ 963.411478] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 963.411691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.449322] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.449562] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.449678] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.449958] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.450119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.450273] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 not found, creating... [ 963.450578] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.450729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.450844] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.451148] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.451307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.451592] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.451745] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.451857] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.452072] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.452201] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.452337] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 is going to be created. [ 963.475671] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.475855] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.475971] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.476339] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.476529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.476758] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.946814] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 963.947269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [req-388f9f93-cecd-4acf-9e07-d0e6892a966a req-03d5fb81-9cba-403d-bbae-adadcb1f78af service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [req-388f9f93-cecd-4acf-9e07-d0e6892a966a req-03d5fb81-9cba-403d-bbae-adadcb1f78af service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [req-388f9f93-cecd-4acf-9e07-d0e6892a966a req-03d5fb81-9cba-403d-bbae-adadcb1f78af service nova] Enqueued Resource ID: ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 with Priority: HIGHEST for action port [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 964.192016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 with Priority: HIGHEST for action port [ 964.193209] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.193977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.194077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.194326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.194437] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.195525] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.195656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.195913] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.196063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.196143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.196362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.196475] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.700032] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.700210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.700418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 with status ACTIVE [ 964.700630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.700743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.700809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.701032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.702366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.702593] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.702700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.702792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.702986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.703116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.703335] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.703493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.703627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.703817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.703926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.704044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8 is going to be updated. [ 964.727226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.727434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.727521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.727762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.727904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.728130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad9dbbfc-d4e6-48c6-9e9c-bda0cb75e8b8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.118838] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 965.119434] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf deletion is rescheduled due to dependency. [ 965.119663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.119923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.120234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.120515] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.120760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.120911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.121173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.121512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.122345] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.250410] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 965.250733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.252248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.252557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.252739] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.252878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.252963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.253152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.254077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.254077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.254077] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.626170] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.757286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.757464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.757508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.758512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.758512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.758512] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.758842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.758842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.758842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.758842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.758971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.758971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.759109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.759177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.759252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.759342] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.008425] env[65080]: INFO networking_nsxv3.common.synchronization [req-7b59ac27-ef29-4798-970d-6819376adea1 req-c7be43e4-f008-40c2-ae92-99ef8fa64bbc tempest-ServerGroupTestJSON-603688985 tempest-ServerGroupTestJSON-603688985-project-member] Enqueued Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 966.011409] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f with Priority: HIGHEST for action security_group_members [ 966.011409] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.011574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.011655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.011909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.012231] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.012382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.015171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.015421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.015522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.015629] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.128472] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.262161] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e64e7d9f-cf01-4bec-a794-828cbbadc52e: rpc.has_security_group_logging(os_id): False [ 966.283627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.283932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.284016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.284258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.284392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.284669] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.284896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.284896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.285084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.285188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.285427] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.285628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.285628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.285744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.285811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.286026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.286132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.286896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.286896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.286896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.286896] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be created. [ 966.351990] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.352240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.352350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.352625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.352871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.366243] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 966.518864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.519222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.519314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.519586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.519681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.519992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.520168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.520216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.520401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.521158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.521158] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f is going to be updated. [ 966.564237] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.564425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.564468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.564800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.564800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.575894] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: IN_PROGRESS for 2s [ 966.633643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.633853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.633943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.634793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.634793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.634793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 966.668379] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.668579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.668639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.668814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.668961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.681420] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 967.430292] env[65080]: INFO networking_nsxv3.common.synchronization [req-d94bcf39-4c0a-4c38-96dd-2e2294c6147c req-ca21579e-21af-446e-8a93-1cea145f8ab5 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 967.430844] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 967.431436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.431562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.431626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.431827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.432022] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.432131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.432191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.432345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.432430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.432525] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.937808] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.379153] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 968.379397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.396795] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.396990] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.397119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.397391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.398073] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.398073] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.398073] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.398342] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.398502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.398731] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.398829] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.398934] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.399052] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.399161] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.399263] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.399391] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.421097] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.421453] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.421602] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.421880] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.422399] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.422696] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.422900] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.423664] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.423907] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.437505] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.587040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f in Status: SUCCESS [ 968.587040] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f deletion is rescheduled due to dependency. [ 968.587040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.693083] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 968.693404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.693656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.693969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.694227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.694392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.694484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.694673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.694760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.694861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.694958] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.927405] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.927738] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.927947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.928299] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.928485] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.928639] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b not found, creating... [ 968.928898] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.929315] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.929315] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.929411] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.929553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.929855] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.930044] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.930169] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.930424] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.930596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.930742] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b is going to be created. [ 968.939628] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.939795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.939839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.940046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.940134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.940232] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 968.956283] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.956530] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.957393] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.957393] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.957393] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.957393] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.985418] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.985589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.985734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.986071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.986418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.996238] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 969.197628] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.703408] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65229547-ee66-4305-8bfe-45dde2354faf: rpc.has_security_group_logging(os_id): False [ 969.736848] env[65080]: INFO networking_nsxv3.common.synchronization [req-d94bcf39-4c0a-4c38-96dd-2e2294c6147c req-9fc7c4f8-e6f3-482c-aa49-da0ba30f3c77 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 969.737164] env[65080]: INFO networking_nsxv3.common.synchronization [req-d94bcf39-4c0a-4c38-96dd-2e2294c6147c req-9fc7c4f8-e6f3-482c-aa49-da0ba30f3c77 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 969.737499] env[65080]: INFO networking_nsxv3.common.synchronization [req-d94bcf39-4c0a-4c38-96dd-2e2294c6147c req-9fc7c4f8-e6f3-482c-aa49-da0ba30f3c77 service nova] Enqueued Resource ID: a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b with Priority: HIGHEST for action port [ 969.738573] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 969.738573] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 969.739038] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b with Priority: HIGHEST for action port [ 969.739537] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.740277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.740277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.740277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.740277] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.741497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.741497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.741497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.741766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.741766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.741849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.741954] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.746714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.746855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.746932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.747134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.747245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.747769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.747769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.747769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.747906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.747906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.748021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 969.823890] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.826069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.826156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.826407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.826634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.840791] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 970.012714] env[65080]: INFO networking_nsxv3.common.synchronization [req-03a95f28-c1df-4b24-9909-905c7e7465aa req-58abe70a-55db-41c0-8956-c2059d978d9b tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 970.013392] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 970.013788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.013937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.014088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.014393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.015043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.015279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.015470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.015725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.015924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.016132] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.244043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.244381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.252164] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b with status ACTIVE [ 970.252452] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.252624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.252689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.253132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.253226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.253433] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.253524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.253592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.253798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.253903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.254132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.254221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.254277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.254415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.254484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.254581] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b is going to be updated. [ 970.280024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.280169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.280169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.281398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.281398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.281398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1d916ce-e5f3-4bd1-9f27-2a3cac9e906b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.422269] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.423113] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.423267] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.423629] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.423904] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.424110] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.424193] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.424489] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.424545] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.424752] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.424923] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.424971] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.425075] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.425180] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.425282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.425463] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.442924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.443113] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 970.443270] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.443437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-298" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.443752] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9004af14-85b5-4437-bdbd-09d445cd04a5 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.443921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.444053] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.444379] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.444519] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9004af14-85b5-4437-bdbd-09d445cd04a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.518083] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.518320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.518390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.520030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.520030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e already deleted. [ 970.520030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.946660] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.947070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.947210] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.947729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.947729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.947843] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9004af14-85b5-4437-bdbd-09d445cd04a5 not found, creating... [ 970.948111] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.948373] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.948551] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.948998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.948998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.949300] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.949573] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.949724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.949962] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.950169] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.950359] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9004af14-85b5-4437-bdbd-09d445cd04a5 is going to be created. [ 970.972745] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.973028] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.973202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.973529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.973899] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.974152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.011211] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 971.011427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.011646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.011935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.012358] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.012505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.012551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.012717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.012795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.013008] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.515948] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.706424] env[65080]: INFO networking_nsxv3.common.synchronization [req-03a95f28-c1df-4b24-9909-905c7e7465aa req-011789a3-30e3-460f-bfca-5c1e749fbcc5 service nova] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 971.706531] env[65080]: INFO networking_nsxv3.common.synchronization [req-03a95f28-c1df-4b24-9909-905c7e7465aa req-011789a3-30e3-460f-bfca-5c1e749fbcc5 service nova] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 971.706676] env[65080]: INFO networking_nsxv3.common.synchronization [req-03a95f28-c1df-4b24-9909-905c7e7465aa req-011789a3-30e3-460f-bfca-5c1e749fbcc5 service nova] Enqueued Resource ID: 9004af14-85b5-4437-bdbd-09d445cd04a5 with Priority: HIGHEST for action port [ 971.707431] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_rules [ 971.707486] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 971.708527] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9004af14-85b5-4437-bdbd-09d445cd04a5 with Priority: HIGHEST for action port [ 971.708527] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.708613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.708737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.713215] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.713215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.713215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.713215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.713215] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.714921] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9004af14-85b5-4437-bdbd-09d445cd04a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.715169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.715169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.715330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.715473] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9004af14-85b5-4437-bdbd-09d445cd04a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.854442] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 971.854672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.019573] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.212324] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.212540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.220056] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.221411] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9004af14-85b5-4437-bdbd-09d445cd04a5 with status ACTIVE [ 972.221845] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.221929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.222068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.222385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.222800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.222800] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.224891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.224891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.224891] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9004af14-85b5-4437-bdbd-09d445cd04a5 is going to be updated. [ 972.252922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.253092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.253092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.253360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.253493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.253678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9004af14-85b5-4437-bdbd-09d445cd04a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.523572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.523572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.523572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.523572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.523572] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.523572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 972.555125] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.555269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.555336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.555656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.556025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.565717] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 972.730207] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.233774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.234165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.234165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.234305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.234454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.234454] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e is going to be created. [ 973.259271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.259420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.259495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.259724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.260278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.274843] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: UNINITIALIZED for 2s [ 974.576155] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 974.576502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.576633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.576850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.577057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.577229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.577229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.577380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.577452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.577538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.577628] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.080033] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.080219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.080263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.080521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.080721] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.080828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.080892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.081065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.081155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.081256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.081409] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.081501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.081558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.081695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.081828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.081914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.081973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.082119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.082194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.082326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.082395] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.092013] env[65080]: INFO networking_nsxv3.common.synchronization [req-f966ea0a-495d-42ad-8388-2e24a1d78abd req-7f94678c-6661-40c6-8d24-1edf7fae75e7 tempest-MigrationsAdminTest-1161874507 tempest-MigrationsAdminTest-1161874507-project-member] Enqueued Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 975.093666] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: defc6278-7bc8-46f9-a983-ce92624f663f with Priority: HIGHEST for action security_group_members [ 975.094165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-defc6278-7bc8-46f9-a983-ce92624f663f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.094165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.094301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.095030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.095030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.095030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.095030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.095282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.095282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.095363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('defc6278-7bc8-46f9-a983-ce92624f663f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.285640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: SUCCESS [ 975.285906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.286183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.286486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.286852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.286967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.286967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.287227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.287336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.287470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.287641] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.586163] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 975.598248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.598389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.598459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.598863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.598863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.598956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.599059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.599118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.599264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.599330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.599412] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f is going to be updated. [ 975.605474] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.605474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.605474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.605697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.605697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.605875] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.605969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.606045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.606778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.606778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.606778] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.606778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.606778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.606778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.607164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.607164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.607299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.607345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.607465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.607526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.607614] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 975.633769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.633961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.633961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.634193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.634333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.643323] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: IN_PROGRESS for 2s [ 975.679652] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.679652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.679652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.680530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.680530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.695315] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 975.790372] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.965847] env[65080]: INFO networking_nsxv3.common.synchronization [req-ceae2d8f-f2c1-4fd4-a60a-119fe2bdde37 req-b76051f3-a214-4fe3-a339-cc89795de031 tempest-ServersAdminTestJSON-50259138 tempest-ServersAdminTestJSON-50259138-project-member] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 975.966480] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGHEST for action security_group_members [ 975.966815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.967808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.967808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.967808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.967808] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.967808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.967808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.968092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.968450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.968450] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.293615] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69bf0a4d-c007-4a2a-a34e-6cb212b0693e: rpc.has_security_group_logging(os_id): False [ 976.318079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.318079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.318079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.318079] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.318275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.318479] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.318617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.318690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.318889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.318987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.319118] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e is going to be created. [ 976.397866] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.398480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.398638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.399131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.399307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.411219] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: IN_PROGRESS for 2s [ 976.471934] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.472280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.472280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.472434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.472628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.472964] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.473182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.473348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.473614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.473769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.473914] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be updated. [ 976.530670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.530826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.530902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.531126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.531285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.541435] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: IN_PROGRESS for 2s [ 977.653319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: defc6278-7bc8-46f9-a983-ce92624f663f in Status: SUCCESS [ 977.653716] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: defc6278-7bc8-46f9-a983-ce92624f663f deletion is rescheduled due to dependency. [ 977.653716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-defc6278-7bc8-46f9-a983-ce92624f663f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.715330] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 977.715763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.095539] env[65080]: INFO networking_nsxv3.common.synchronization [None req-834b14d0-79ae-4e2f-a859-05ab3eb8a6fc None None] Enqueued Resource ID: c33f33bb-34b6-4df6-a810-33ae92df31ef with Priority: HIGHEST for action port [ 978.097661] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c33f33bb-34b6-4df6-a810-33ae92df31ef with Priority: HIGHEST for action port [ 978.098598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c33f33bb-34b6-4df6-a810-33ae92df31ef taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.099835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c33f33bb-34b6-4df6-a810-33ae92df31ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.099835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c33f33bb-34b6-4df6-a810-33ae92df31ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.100242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c33f33bb-34b6-4df6-a810-33ae92df31ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.100578] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c33f33bb-34b6-4df6-a810-33ae92df31ef',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.427037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: SUCCESS [ 978.427037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.554854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a in Status: SUCCESS [ 978.556464] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a deletion is rescheduled due to dependency. [ 978.556464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.603982] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c33f33bb-34b6-4df6-a810-33ae92df31ef [ 978.604718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.605011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.605143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.605535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.605704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.605865] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c33f33bb-34b6-4df6-a810-33ae92df31ef already deleted. [ 978.605999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c33f33bb-34b6-4df6-a810-33ae92df31ef" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.571281] env[65080]: INFO networking_nsxv3.common.synchronization [req-b50693dd-09db-407d-8e49-11f4857e4902 req-190c4b39-6615-48d4-a2c9-c4f9847db07b tempest-ServerDiagnosticsNegativeTest-508298487 tempest-ServerDiagnosticsNegativeTest-508298487-project-member] Enqueued Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 979.571281] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 979.575032] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.575032] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.575032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.575490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.575490] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.063410] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.063617] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.063778] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.064185] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.064477] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.064648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.064784] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.065052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.065226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.065495] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.065653] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.065799] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.065915] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.066092] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.066211] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.070228] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.080058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.080058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.080058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.081825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.081825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.081825] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 already deleted. [ 980.081825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.097567] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.097567] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.097567] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.097567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-293" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.097567] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-71c96b9b-0dad-4cd7-83c0-6b05925724cc taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.097567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.097567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.097567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.097567] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c96b9b-0dad-4cd7-83c0-6b05925724cc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.600239] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.600604] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.600604] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.600878] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.601046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.601202] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 71c96b9b-0dad-4cd7-83c0-6b05925724cc not found, creating... [ 980.601464] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.601621] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.601767] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.601991] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.602146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.602437] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.602593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.602717] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.602913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.603623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.603905] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 71c96b9b-0dad-4cd7-83c0-6b05925724cc is going to be created. [ 980.625502] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.625741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.625847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.626138] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.626362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.626656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.159556] env[65080]: INFO networking_nsxv3.common.synchronization [req-070bdc04-ab4c-4d88-90a2-93c65690a712 req-e9481498-8677-4a7c-86a2-c83f95f7b60c tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 981.160092] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 981.160441] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.161641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.161739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.161974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.162174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.162315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.162382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.162555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.162645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.162745] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.210684] env[65080]: INFO networking_nsxv3.common.synchronization [None req-77816425-065d-4c53-81fd-bf63888fa266 None None] Enqueued Resource ID: 7c1290ac-f5e6-45d5-a28e-f7c6cad1e422 with Priority: HIGHEST for action port [ 981.214872] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c1290ac-f5e6-45d5-a28e-f7c6cad1e422 with Priority: HIGHEST for action port [ 981.214872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c1290ac-f5e6-45d5-a28e-f7c6cad1e422 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.218253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c1290ac-f5e6-45d5-a28e-f7c6cad1e422" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.218253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c1290ac-f5e6-45d5-a28e-f7c6cad1e422" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.218253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c1290ac-f5e6-45d5-a28e-f7c6cad1e422" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.218253] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c1290ac-f5e6-45d5-a28e-f7c6cad1e422',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.467829] env[65080]: INFO networking_nsxv3.common.synchronization [req-b50693dd-09db-407d-8e49-11f4857e4902 req-09b22792-1cf2-49bd-bcee-217fd4b55def service nova] Enqueued Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_rules [ 981.467829] env[65080]: INFO networking_nsxv3.common.synchronization [req-b50693dd-09db-407d-8e49-11f4857e4902 req-09b22792-1cf2-49bd-bcee-217fd4b55def service nova] Enqueued Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 981.467829] env[65080]: INFO networking_nsxv3.common.synchronization [req-b50693dd-09db-407d-8e49-11f4857e4902 req-09b22792-1cf2-49bd-bcee-217fd4b55def service nova] Enqueued Resource ID: 71c96b9b-0dad-4cd7-83c0-6b05925724cc with Priority: HIGHEST for action port [ 981.468453] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_rules [ 981.468648] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 981.468756] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71c96b9b-0dad-4cd7-83c0-6b05925724cc with Priority: HIGHEST for action port [ 981.469070] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.469214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.469293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.469599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.469670] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.470672] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.470871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.470944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.471440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.471440] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.471624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.471624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.472010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.472010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.472010] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.473128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-71c96b9b-0dad-4cd7-83c0-6b05925724cc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.473293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.473371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.473606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.473684] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71c96b9b-0dad-4cd7-83c0-6b05925724cc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.667829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.668254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.668254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.668335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.668469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.668611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.668709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.668765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.668923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.668999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.669100] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 981.696212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.696384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.696513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.696660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.697220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.707015] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 981.718883] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c1290ac-f5e6-45d5-a28e-f7c6cad1e422 [ 981.719085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.719259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.719259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.719480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.719575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.719682] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c1290ac-f5e6-45d5-a28e-f7c6cad1e422 already deleted. [ 981.719770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c1290ac-f5e6-45d5-a28e-f7c6cad1e422" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.975702] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.975885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.977363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.978552] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71c96b9b-0dad-4cd7-83c0-6b05925724cc with status ACTIVE [ 981.978674] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.978802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.978903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.979410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.979410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.979536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.979594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.979659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.979853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.979947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.980156] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.980243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.980301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.981334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.981334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.981334] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71c96b9b-0dad-4cd7-83c0-6b05925724cc is going to be updated. [ 982.003646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.003646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.003646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.003646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.003820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.003850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71c96b9b-0dad-4cd7-83c0-6b05925724cc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.482774] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.580263] env[65080]: INFO networking_nsxv3.common.synchronization [req-fe86e488-686a-4876-a256-200bddcb495c req-4f4ab60c-f669-4308-958c-cf13986473f1 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 982.580867] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 982.581473] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.581473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.581473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.581473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.581733] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.582087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.582087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.582087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.582225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.582263] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.985771] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.986146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.986146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.986233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.986322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.986487] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 is going to be created. [ 983.012718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.012874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.012928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.013170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.013337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.030705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: UNINITIALIZED for 2s [ 983.084284] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.587189] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.717250] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 983.717250] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 983.717250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.032870] env[65080]: INFO networking_nsxv3.common.synchronization [None req-dab84cb6-43e8-441a-a74f-f8a9665e166e None None] Enqueued Resource ID: 55731f30-d1a9-4484-a451-41809bbbcfd1 with Priority: HIGHEST for action port [ 984.033417] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55731f30-d1a9-4484-a451-41809bbbcfd1 with Priority: HIGHEST for action port [ 984.033758] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-55731f30-d1a9-4484-a451-41809bbbcfd1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.033882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55731f30-d1a9-4484-a451-41809bbbcfd1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.034030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55731f30-d1a9-4484-a451-41809bbbcfd1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.034462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55731f30-d1a9-4484-a451-41809bbbcfd1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.034543] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55731f30-d1a9-4484-a451-41809bbbcfd1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.092486] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.092486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.092486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.092486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.092486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.092486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 984.124772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.124772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.124772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.124772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.124772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.134460] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 984.537109] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55731f30-d1a9-4484-a451-41809bbbcfd1 [ 984.539571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.539571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.539571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.539571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.539571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.539571] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55731f30-d1a9-4484-a451-41809bbbcfd1 already deleted. [ 984.539571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55731f30-d1a9-4484-a451-41809bbbcfd1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.042945] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: SUCCESS [ 985.042945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.042945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.042945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.045285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.045285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.045285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.045285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.045285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.045285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.045285] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.549134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.549250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.549329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.549586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.549772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.550664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.550664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.550946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.550946] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.551053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.551087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.551445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.551445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.551445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.551564] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.054073] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b61ca41-342a-486f-b32c-2246f071cb26: rpc.has_security_group_logging(os_id): False [ 986.073684] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.073889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.073889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.075183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.075555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.075782] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.075886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.075950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.077127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.077325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.077425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.077490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.077734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.077824] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 is going to be created. [ 986.139112] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.139662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.139812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.140116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.140368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.150740] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 986.150740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.153758] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: IN_PROGRESS for 2s [ 986.902806] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-510f0d91-3a91-4a2d-bc1d-cb7d68cdf4db tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 986.903456] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 986.903898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.903898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.904049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.904232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.904389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.904499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.904544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.904693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.904778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.904870] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.353073] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.353073] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.353416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.353860] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.354149] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.354313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.354428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.354655] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.354813] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.355068] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.355186] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.355291] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.355397] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.355601] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.355722] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.355857] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.378054] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.378269] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.378411] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.378585] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.378976] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-fc9eaae2-d572-489c-9258-dac34c757739 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.379245] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.379378] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.379811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.380067] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9eaae2-d572-489c-9258-dac34c757739',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.407663] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.407888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.407888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.408148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.408260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.408482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.408605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.408691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.408852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.408944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.409098] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 already deleted. [ 987.409140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.883192] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.883347] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.883605] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.883914] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.884135] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.884248] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port fc9eaae2-d572-489c-9258-dac34c757739 not found, creating... [ 987.884516] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.884821] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.884884] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.885091] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.885230] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.885591] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.885847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.885966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.886191] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.886325] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.886466] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: fc9eaae2-d572-489c-9258-dac34c757739 is going to be created. [ 987.907596] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.907804] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.907908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.908420] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.908590] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.908822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.168056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: SUCCESS [ 988.168765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.632843] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-4c780956-72a8-4c1e-9d64-869f22c4c7ca service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 988.633162] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-4c780956-72a8-4c1e-9d64-869f22c4c7ca service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 988.633162] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-4c780956-72a8-4c1e-9d64-869f22c4c7ca service nova] Enqueued Resource ID: fc9eaae2-d572-489c-9258-dac34c757739 with Priority: HIGHEST for action port [ 988.636904] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 988.637116] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 988.637244] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9eaae2-d572-489c-9258-dac34c757739 with Priority: HIGHEST for action port [ 988.637614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.637788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.637897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.638215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.638324] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.639385] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.639546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.639579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.639780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.639933] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.640035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.640101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.640242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.640326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.640429] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.642026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9eaae2-d572-489c-9258-dac34c757739 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.642026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.642026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.642026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.642026] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9eaae2-d572-489c-9258-dac34c757739',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.131195] env[65080]: INFO networking_nsxv3.common.synchronization [None req-0ef2cf41-82dc-4bcb-949a-4a7b8ee26197 None None] Enqueued Resource ID: 8d79b21c-b03d-4973-8ad0-5e296108cb0a with Priority: HIGHEST for action port [ 989.131417] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d79b21c-b03d-4973-8ad0-5e296108cb0a with Priority: HIGHEST for action port [ 989.131741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d79b21c-b03d-4973-8ad0-5e296108cb0a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.131846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d79b21c-b03d-4973-8ad0-5e296108cb0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.131920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d79b21c-b03d-4973-8ad0-5e296108cb0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.133649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d79b21c-b03d-4973-8ad0-5e296108cb0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.133649] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d79b21c-b03d-4973-8ad0-5e296108cb0a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.150891] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.150891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.150891] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc9eaae2-d572-489c-9258-dac34c757739 with status ACTIVE [ 989.150891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.150891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.150891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.152331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.152331] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.152331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.152331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.152331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.152331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.152331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc9eaae2-d572-489c-9258-dac34c757739 is going to be updated. [ 989.180198] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.180444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.180506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.180794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.181015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.181272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9eaae2-d572-489c-9258-dac34c757739" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.344319] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-cf22472d-41cd-4b54-9908-091a249f3838 tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 989.344797] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 989.345265] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.346223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.634215] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d79b21c-b03d-4973-8ad0-5e296108cb0a [ 989.635959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.635959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.635959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.635959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.635959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.636190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d79b21c-b03d-4973-8ad0-5e296108cb0a already deleted. [ 989.636190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d79b21c-b03d-4973-8ad0-5e296108cb0a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.655266] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.764809] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.765653] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.765653] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.765755] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.766019] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.766937] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.767099] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.767327] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.767927] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.767927] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.767927] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.767927] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.768110] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.768110] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.768230] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.768337] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.786934] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.787140] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.787317] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.787461] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.787833] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-57020890-e87c-414e-b9db-c169222d857f taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.788019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.788747] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.788747] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.788747] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57020890-e87c-414e-b9db-c169222d857f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.164263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.164424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.164495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.164710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.164800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.164907] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be created. [ 990.192433] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.192667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.192747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.193144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.193144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.205356] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: UNINITIALIZED for 2s [ 990.292247] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.292247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.292247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.292415] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.292806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.292806] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 57020890-e87c-414e-b9db-c169222d857f not found, creating... [ 990.293528] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.293528] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.293528] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.293776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.293850] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.297172] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.298149] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.298149] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.298265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.298391] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.298522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 57020890-e87c-414e-b9db-c169222d857f is going to be created. [ 990.324686] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.324900] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.325042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.325707] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.326051] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.326885] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.972389] env[65080]: INFO networking_nsxv3.common.synchronization [req-771ed66d-f515-40b7-a7c0-c78e03b56aa0 req-27cd9865-5b4e-4b7a-aa4d-89b6146dcf4a tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 990.972917] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 990.973245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.973419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.973480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.973665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.973900] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.973987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.973987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.974161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.974239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.974334] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.089837] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-cf2ac981-41b3-46ec-b332-99fbde75f2f7 service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 991.090486] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-cf2ac981-41b3-46ec-b332-99fbde75f2f7 service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 991.090765] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-cf2ac981-41b3-46ec-b332-99fbde75f2f7 service nova] Enqueued Resource ID: 57020890-e87c-414e-b9db-c169222d857f with Priority: HIGHEST for action port [ 991.091520] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 991.091740] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 991.091902] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57020890-e87c-414e-b9db-c169222d857f with Priority: HIGHEST for action port [ 991.092343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.092505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.092827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.092965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.093286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-57020890-e87c-414e-b9db-c169222d857f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.093499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.093559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.093845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.094096] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57020890-e87c-414e-b9db-c169222d857f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.477253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.477253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.477253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.477253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.477253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.477459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.477459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.477459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.478092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.478092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.478092] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be updated. [ 991.513626] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.513794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.513886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.514111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.514257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.525477] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 991.597170] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57020890-e87c-414e-b9db-c169222d857f with status ACTIVE [ 991.597170] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.597170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597170] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.597646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.597810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.598029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.598114] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57020890-e87c-414e-b9db-c169222d857f is going to be updated. [ 991.629034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.629034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.629034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.629034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.629034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.629034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57020890-e87c-414e-b9db-c169222d857f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.659922] env[65080]: INFO networking_nsxv3.common.synchronization [None req-bf96d942-44e7-4158-b541-74baebd5d06c None None] Enqueued Resource ID: 81969518-97f9-4a42-9e33-e8911c1cd0f9 with Priority: HIGHEST for action port [ 991.660290] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81969518-97f9-4a42-9e33-e8911c1cd0f9 with Priority: HIGHEST for action port [ 991.660654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-81969518-97f9-4a42-9e33-e8911c1cd0f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.660654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81969518-97f9-4a42-9e33-e8911c1cd0f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.661254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81969518-97f9-4a42-9e33-e8911c1cd0f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.661254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81969518-97f9-4a42-9e33-e8911c1cd0f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.661254] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81969518-97f9-4a42-9e33-e8911c1cd0f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.843732] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-825ca9cb-5982-42f9-a97f-af29a18325ff tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 991.843732] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 991.843988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.844114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.130025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.130025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.130025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.130025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.130025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.130494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.130494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.130652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.130824] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.131052] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.131166] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.131271] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.131566] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.131702] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.131832] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.131971] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.152212] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.152366] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.152497] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.152677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-464" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.153024] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-3a560aad-35a3-46c7-a133-bdbb06de74c0 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.153277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.153330] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.153767] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.153916] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a560aad-35a3-46c7-a133-bdbb06de74c0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.162605] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81969518-97f9-4a42-9e33-e8911c1cd0f9 [ 992.162858] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.163992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.164132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.164424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.164591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.164660] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81969518-97f9-4a42-9e33-e8911c1cd0f9 already deleted. [ 992.164745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81969518-97f9-4a42-9e33-e8911c1cd0f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.215888] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 992.215888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.216196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.216446] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.216541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.216667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.216740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.216779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216965] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.217906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.218024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.218181] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.218289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.218342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.218478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.218548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.218634] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.656365] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.656600] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.656726] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.656988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.657147] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.657294] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 3a560aad-35a3-46c7-a133-bdbb06de74c0 not found, creating... [ 992.657537] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.657740] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.657863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.658079] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.658207] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.658468] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.658623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.658730] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.658921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.659083] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.659217] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 3a560aad-35a3-46c7-a133-bdbb06de74c0 is going to be created. [ 992.662220] env[65080]: INFO networking_nsxv3.common.synchronization [req-f797f067-130e-4304-ab40-96bbc6ce54e6 req-0fa57604-499d-4bdf-bf2e-3ee53d8e03e6 tempest-ServerDiagnosticsNegativeTest-508298487 tempest-ServerDiagnosticsNegativeTest-508298487-project-member] Enqueued Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 992.662714] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGHEST for action security_group_members [ 992.663299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.663387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.663461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.663613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.663806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.663922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.663992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.664125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.664193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.664283] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.696940] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.697306] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.697513] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.697967] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.698263] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.698590] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.720940] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.721209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.721294] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.166550] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.167054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.167054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.167168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.167235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.167418] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.167515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.167579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.167733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.167818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.167891] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 is going to be updated. [ 993.204588] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.204812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.204812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.205160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.205304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.217687] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: IN_PROGRESS for 2s [ 993.223282] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-c0c4f72b-ccb6-4351-bb20-c822d5101594 service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-c0c4f72b-ccb6-4351-bb20-c822d5101594 service nova] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [req-9439ac76-7095-454b-8831-db5afabb967e req-c0c4f72b-ccb6-4351-bb20-c822d5101594 service nova] Enqueued Resource ID: 3a560aad-35a3-46c7-a133-bdbb06de74c0 with Priority: HIGHEST for action port [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_rules [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 993.443023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a560aad-35a3-46c7-a133-bdbb06de74c0 with Priority: HIGHEST for action port [ 993.443884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.443884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.443884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.443884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.444448] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a560aad-35a3-46c7-a133-bdbb06de74c0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.444448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.444448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.444448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.444647] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a560aad-35a3-46c7-a133-bdbb06de74c0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.536581] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 993.536581] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e deletion is rescheduled due to dependency. [ 993.536581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.725566] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.726144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.726144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.726144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.726144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.726317] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 993.755429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.755757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.755827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.756064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.756341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.765748] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 993.950550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a560aad-35a3-46c7-a133-bdbb06de74c0 with status ACTIVE [ 993.950696] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.950840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.950911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.951148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.952019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.952019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.952019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.952019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.952019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.952019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.952019] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.952452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.952452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.952452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.952452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.952452] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a560aad-35a3-46c7-a133-bdbb06de74c0 is going to be updated. [ 993.974409] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.974409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.974409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.974409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.974409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.974409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a560aad-35a3-46c7-a133-bdbb06de74c0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.280722] env[65080]: INFO networking_nsxv3.common.synchronization [req-9eda034f-4940-4015-af74-a98daf61166d req-b775a9aa-8345-407d-8286-f694d6d1ab62 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 994.281324] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 994.281864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.281864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.281864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.282066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.282187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.282292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.282351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.282681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.282681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.282841] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.786063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.786250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.786317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.786505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.786635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.786846] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.786951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.787028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.787196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.787279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.787369] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 994.824670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.824822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.824896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.825126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.825268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.834316] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 995.047991] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.048205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.048330] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.048593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.048849] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.049012] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.049127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.049332] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.049479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.049724] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.049794] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.049942] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.050110] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.050236] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.050324] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.050458] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.068919] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.069105] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.069244] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.069422] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.069736] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.069893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.070022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.070396] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.070626] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12dfc1ee-56b0-4414-947c-c24b6ad99f2e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.228989] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b61ca41-342a-486f-b32c-2246f071cb26 in Status: SUCCESS [ 995.229186] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 deletion is rescheduled due to dependency. [ 995.229302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.573305] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.573690] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.573730] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.574181] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.574439] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.574685] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 12dfc1ee-56b0-4414-947c-c24b6ad99f2e not found, creating... [ 995.575112] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.575375] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.575596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.575885] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.576100] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.576501] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.576740] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.576944] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.577254] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.577610] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.577610] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 12dfc1ee-56b0-4414-947c-c24b6ad99f2e is going to be created. [ 995.603769] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.604096] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.604369] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.604850] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.605295] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.605687] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.778200] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 995.778200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.778200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.778200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.778477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.778546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.778644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.778904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.779048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.779219] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.282014] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.337335] env[65080]: INFO networking_nsxv3.common.synchronization [req-9eda034f-4940-4015-af74-a98daf61166d req-4b30dce4-d287-4ae4-9b15-8ab3b8f004cf service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 996.337517] env[65080]: INFO networking_nsxv3.common.synchronization [req-9eda034f-4940-4015-af74-a98daf61166d req-4b30dce4-d287-4ae4-9b15-8ab3b8f004cf service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 996.338120] env[65080]: INFO networking_nsxv3.common.synchronization [req-9eda034f-4940-4015-af74-a98daf61166d req-4b30dce4-d287-4ae4-9b15-8ab3b8f004cf service nova] Enqueued Resource ID: 12dfc1ee-56b0-4414-947c-c24b6ad99f2e with Priority: HIGHEST for action port [ 996.338619] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 996.338770] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 996.338850] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12dfc1ee-56b0-4414-947c-c24b6ad99f2e with Priority: HIGHEST for action port [ 996.339654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.339827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.339939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.340308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.340454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.342490] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.342595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.342804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.342911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.343008] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.343175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.343255] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12dfc1ee-56b0-4414-947c-c24b6ad99f2e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.785133] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.843773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.843990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.845784] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 996.845967] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 996.846099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.846334] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12dfc1ee-56b0-4414-947c-c24b6ad99f2e with status ACTIVE [ 996.846549] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.846669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.846728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.846941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.847036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.847262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.847398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.847438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.847595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.847712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.847885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.847988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.848113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.848238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.848319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.848403] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12dfc1ee-56b0-4414-947c-c24b6ad99f2e is going to be updated. [ 996.849500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.849679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.849841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.849937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.850025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.850181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.850299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.851049] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.871405] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.871629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.871629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.871820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.871949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.872176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12dfc1ee-56b0-4414-947c-c24b6ad99f2e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.288841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.288984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.288984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.289344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.289499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.289662] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 997.326067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.326253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.326364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.326720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.326845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.337525] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 997.353051] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.856336] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.017986] env[65080]: INFO networking_nsxv3.common.synchronization [req-e5f0768d-7d27-40c1-8a7b-335d090acd1a req-400bc565-6c3c-4296-94e8-3e4a6765d3fa tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 998.018801] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGHEST for action security_group_members [ 998.018988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.019128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.019197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.019469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.019554] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.019654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.019716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.019859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.019961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.020139] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.361024] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.361300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.361300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.363838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.363838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.363838] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 998.399882] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.399882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.399882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.399882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.399882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.409896] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 998.523137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.523298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.523372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.523625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.524076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.524076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.524242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.524329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.524584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.524703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.524807] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c is going to be updated. [ 998.562927] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.563075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.563144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.563364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.563837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.573954] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: IN_PROGRESS for 2s [ 999.347244] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 999.347526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.347610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.347817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.348174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.348309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.348376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.348533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.348615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.348719] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.850642] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.353692] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.422127] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1000.422348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.422515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.422731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.422931] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.423058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.423127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.423491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.423607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.423778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.423778] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.585479] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3269206-fb2c-48bf-b03a-c5065b747a8c in Status: SUCCESS [ 1000.585479] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c deletion is rescheduled due to dependency. [ 1000.585479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.857078] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.857078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.857078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.857078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.857078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.857396] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1000.886132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.886299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.886379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.886639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.886808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.895140] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1000.925841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.926137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.926137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.926304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.926464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.926565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.926623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.926833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.926926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.927027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.927188] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.927289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.927346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.927488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.927659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.927759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.927816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.928052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.928141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.928246] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.430766] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d: rpc.has_security_group_logging(os_id): False [ 1001.450215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.450410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.450464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.450637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.450849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.451125] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.451233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.451343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.451456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.451592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.451751] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.451884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.451922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.452040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.452121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.452299] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.452388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.452447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.452581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.452654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.452738] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1001.524138] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.524419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.524612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.524894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.525067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.539491] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1002.907838] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1002.908255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.908295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.908596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.908826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.909011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.909088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.909285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.909398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.909508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.909712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.909824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.909907] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.910123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.910263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.910440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.910440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.910606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.910685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.910758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.910849] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.911981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.912251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.912364] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.912486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.912564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.912769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.912898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.913052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.020057] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1003.020246] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1003.415513] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce4187d3-007a-4148-bd27-340ca7f73a61: rpc.has_security_group_logging(os_id): False [ 1003.417048] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.438927] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.439102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.439171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.439400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.439492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.439717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.439816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.439894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.440084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.440179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.440394] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.440498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.440569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.440725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.440801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.440993] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.441124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.441186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.441346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.441421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.441508] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be created. [ 1003.506645] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.506753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.506833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.507145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.521426] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1003.555282] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1003.555532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.919925] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.040228] env[65080]: INFO networking_nsxv3.common.synchronization [req-5445a3a6-c329-4624-9baf-79d924d90cbe req-24a7e08d-1eed-43fe-a606-557dd2717813 tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1004.040871] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1004.041705] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.041705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.041705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.042012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.042234] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.042376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.042474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.042719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.042868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.043073] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.416654] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.416979] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.417521] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.417934] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.418232] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.418428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.418575] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.419881] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.420158] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.420397] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.420862] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.420989] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.421170] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.421365] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.421537] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.421695] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.426072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.426284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.426439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.426726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.426869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.427024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1004.444499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.444756] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.444949] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.445154] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.445524] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-2fa4bc35-effb-443c-b3ad-307f56df56a4 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.445884] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.446064] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.446592] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.446592] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa4bc35-effb-443c-b3ad-307f56df56a4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.461314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.461517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.461573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.461887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.462056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.476488] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1004.544957] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.545246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.545333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.545656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.545802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.546132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.546319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.546415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.546683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.546806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.546947] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 already deleted. [ 1004.547110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.754594] env[65080]: INFO networking_nsxv3.common.synchronization [req-419f87c4-3ca9-40fc-a3ce-194ab5187ec6 req-e8078f8c-0233-4340-8b4b-91fcb8728850 tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1004.755163] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1004.755520] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.755671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951032] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.951032] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 2fa4bc35-effb-443c-b3ad-307f56df56a4 not found, creating... [ 1004.951032] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.951032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.951831] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.951831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.951831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.951831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.951831] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.951831] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 2fa4bc35-effb-443c-b3ad-307f56df56a4 is going to be created. [ 1004.977215] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.977215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.977215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.977215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.977215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.977215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.540329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1005.540647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.540848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.541115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.541498] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.723621] env[65080]: INFO networking_nsxv3.common.synchronization [req-5445a3a6-c329-4624-9baf-79d924d90cbe req-502e0705-5942-4253-a1c0-d63f919c5cb1 service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1005.723718] env[65080]: INFO networking_nsxv3.common.synchronization [req-5445a3a6-c329-4624-9baf-79d924d90cbe req-502e0705-5942-4253-a1c0-d63f919c5cb1 service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1005.723964] env[65080]: INFO networking_nsxv3.common.synchronization [req-5445a3a6-c329-4624-9baf-79d924d90cbe req-502e0705-5942-4253-a1c0-d63f919c5cb1 service nova] Enqueued Resource ID: 2fa4bc35-effb-443c-b3ad-307f56df56a4 with Priority: HIGHEST for action port [ 1005.725181] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1005.725414] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1005.725636] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa4bc35-effb-443c-b3ad-307f56df56a4 with Priority: HIGHEST for action port [ 1005.726118] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.726309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.726432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.726873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.727015] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.728245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.728419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.728671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.728781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.729057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.729165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.729262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.729484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.729625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.729971] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.731169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa4bc35-effb-443c-b3ad-307f56df56a4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.731169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.731317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.731518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.731518] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa4bc35-effb-443c-b3ad-307f56df56a4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.043962] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.044459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.234235] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.234522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.234795] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.236099] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fa4bc35-effb-443c-b3ad-307f56df56a4 with status ACTIVE [ 1006.236366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.236556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.236701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.236931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.237034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.237242] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.237373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.237450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.237615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.237737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.238017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.238201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.238315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.238376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.238460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.238550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fa4bc35-effb-443c-b3ad-307f56df56a4 is going to be updated. [ 1006.264043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.264043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.264043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.264043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.264320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.264425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa4bc35-effb-443c-b3ad-307f56df56a4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.489250] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1006.489494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.489708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.490066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.490066] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.490273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.490273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.491517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.491517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.491517] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.741083] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.753395] env[65080]: INFO networking_nsxv3.common.synchronization [None req-4d2c8f98-0ee5-4919-a8db-dfd2d520bdd2 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1006.754210] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1006.756054] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.756054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.756054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.756054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.756054] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.859169] env[65080]: INFO networking_nsxv3.common.synchronization [None req-4c524a04-32d6-407b-a411-0ae9530cdbfd tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1006.860028] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1006.860251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.860251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.994471] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.243500] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.243852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.243852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.244186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.244369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.244474] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be created. [ 1007.294523] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.294757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.294863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.295384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.295668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.295668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 already deleted. [ 1007.295798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.298431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.298677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.298798] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.300723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.300857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.300910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.301136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.301316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.311896] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: UNINITIALIZED for 2s [ 1007.403309] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.403427] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.497599] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.823826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.824406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.824406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.824406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.824406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.824544] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 already deleted. [ 1007.824544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.004122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.004122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.004122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.004324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.004324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.004390] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1008.042070] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.043025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.043025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.043025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.043025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.058043] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1009.324179] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1009.324179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.324179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.324638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.324638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.324638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.324638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.324869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.324869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.324869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.325071] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.831181] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.831181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.831181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.831181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.831619] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.831619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.831619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.831786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.831786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.831921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.832107] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.832193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.832248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.832400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.832624] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.832710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.832710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.833176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.833176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.833176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.833176] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.068762] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1010.068982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.069174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.069388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.069583] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.069700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.069766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.069917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.069996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.070089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.070179] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.335658] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f218e741-66ae-4212-b505-022023a657a5: rpc.has_security_group_logging(os_id): False [ 1010.354522] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.358391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.358391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.358669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.358669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359119] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.359119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.359119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.359267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.359350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359568] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.359663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.359791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.359938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360236] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.360369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.360428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360702] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be created. [ 1010.430393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.430579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.430678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.431115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.432432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.445378] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1010.576269] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.576269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.576269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.576269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.576748] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.576748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.576748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.576748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.576979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.576979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.577115] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.578081] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.578081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.578672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.578672] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.084487] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce4187d3-007a-4148-bd27-340ca7f73a61: rpc.has_security_group_logging(os_id): False [ 1011.103806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.103970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.104032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.104244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.104333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.104534] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.104631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.104712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.104859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.104935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.105149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.105241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.105303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.105440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.105514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.105717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.105812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.105873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.106022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.106216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.106311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1011.172996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.173384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.173384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.174033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.174033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.188584] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1011.518891] env[65080]: INFO networking_nsxv3.common.synchronization [None req-4a29f352-2d76-429f-89d5-4d631555c5cc None None] Enqueued Resource ID: d638deb9-b510-4bc4-96e1-214a357c3f12 with Priority: HIGHEST for action port [ 1011.519517] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d638deb9-b510-4bc4-96e1-214a357c3f12 with Priority: HIGHEST for action port [ 1011.520240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d638deb9-b510-4bc4-96e1-214a357c3f12 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.520341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d638deb9-b510-4bc4-96e1-214a357c3f12" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.520418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d638deb9-b510-4bc4-96e1-214a357c3f12" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.520785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d638deb9-b510-4bc4-96e1-214a357c3f12" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.520920] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d638deb9-b510-4bc4-96e1-214a357c3f12',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.023063] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d638deb9-b510-4bc4-96e1-214a357c3f12 [ 1012.023180] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.023270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.023359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.024042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.024042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.024042] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d638deb9-b510-4bc4-96e1-214a357c3f12 already deleted. [ 1012.024042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d638deb9-b510-4bc4-96e1-214a357c3f12" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.459395] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1012.459680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.466162] env[65080]: INFO networking_nsxv3.common.synchronization [req-e7249c97-954a-4eb8-ace7-1805afb3c038 req-64b6d3ff-be23-438a-a213-88fa69e7c79f tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1012.466939] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1012.467408] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.467551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.467623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.467895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.468157] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.468329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.468447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.468721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.468820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.468922] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.917641] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.917641] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.917641] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.918721] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.919113] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.919362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.919569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.919926] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.920190] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.920479] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.920801] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.921644] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.922029] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.922185] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.922296] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.922436] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.946527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.946745] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.946907] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.947806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.948204] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-f38b7212-0352-43b8-be6e-ca5640dd69f1 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.948204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.948204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.948763] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.948763] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38b7212-0352-43b8-be6e-ca5640dd69f1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.975850] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.205337] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1013.205583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.205838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.206070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.206168] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.454025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.454025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port f38b7212-0352-43b8-be6e-ca5640dd69f1 not found, creating... [ 1013.454025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.454025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.455143] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.455346] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.455476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.455756] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.455906] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.456072] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: f38b7212-0352-43b8-be6e-ca5640dd69f1 is going to be created. [ 1013.480824] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.481303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.481651] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.481835] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.482164] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.482474] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.483467] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.709135] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.709417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.709417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.710101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.710101] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.710101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.710316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.710448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.710755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.710755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.710884] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.987209] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.987576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.987576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.987686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.987740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.987844] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1014.020610] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.020610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.020610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.020610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.020966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.034407] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1014.214221] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.214453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.214601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.214847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.215085] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.215242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.215332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.215556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.215685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.215784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.215972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.216083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.216226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.216398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.216607] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.216727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.216793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.216960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.217360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.217360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.217360] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.333428] env[65080]: INFO networking_nsxv3.common.synchronization [req-e7249c97-954a-4eb8-ace7-1805afb3c038 req-72d6dc14-cc2d-48bd-ad83-0c47f91bd6f1 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1014.333705] env[65080]: INFO networking_nsxv3.common.synchronization [req-e7249c97-954a-4eb8-ace7-1805afb3c038 req-72d6dc14-cc2d-48bd-ad83-0c47f91bd6f1 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1014.333906] env[65080]: INFO networking_nsxv3.common.synchronization [req-e7249c97-954a-4eb8-ace7-1805afb3c038 req-72d6dc14-cc2d-48bd-ad83-0c47f91bd6f1 service nova] Enqueued Resource ID: f38b7212-0352-43b8-be6e-ca5640dd69f1 with Priority: HIGHEST for action port [ 1014.334714] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1014.334906] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1014.335063] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f38b7212-0352-43b8-be6e-ca5640dd69f1 with Priority: HIGHEST for action port [ 1014.335459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.335728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.335799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.336111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.336227] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.337746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.337746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.337972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-f38b7212-0352-43b8-be6e-ca5640dd69f1 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.338132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.339569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.339569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.339569] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38b7212-0352-43b8-be6e-ca5640dd69f1',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.721062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce4187d3-007a-4148-bd27-340ca7f73a61: rpc.has_security_group_logging(os_id): False [ 1014.743023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.743023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.743023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.743023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.743674] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.743674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.743674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.743674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.743674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.745035] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1014.813808] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.814114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.814114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.814262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.814454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.830862] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1014.839479] env[65080]: INFO networking_nsxv3.common.synchronization [None req-af4a18db-0d4a-49ad-9bad-d2752d7c4d83 None None] Enqueued Resource ID: e6b8d784-6857-41e7-a3da-1353cee8a0c8 with Priority: HIGHEST for action port [ 1014.840532] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6b8d784-6857-41e7-a3da-1353cee8a0c8 with Priority: HIGHEST for action port [ 1014.840907] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.841029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.841339] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6b8d784-6857-41e7-a3da-1353cee8a0c8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.841451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6b8d784-6857-41e7-a3da-1353cee8a0c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.841528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6b8d784-6857-41e7-a3da-1353cee8a0c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.841833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6b8d784-6857-41e7-a3da-1353cee8a0c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.841965] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6b8d784-6857-41e7-a3da-1353cee8a0c8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.844768] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f38b7212-0352-43b8-be6e-ca5640dd69f1 with status ACTIVE [ 1014.845616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.845616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.850020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.850020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.850020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.850020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f38b7212-0352-43b8-be6e-ca5640dd69f1 is going to be updated. [ 1014.898648] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.898879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.898989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.899226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.899362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.901473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f38b7212-0352-43b8-be6e-ca5640dd69f1" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.107271] env[65080]: INFO networking_nsxv3.common.synchronization [req-7750b3a2-ea6a-4732-a036-d9fa93a3208f req-a7660ed7-9edc-4b10-913d-fe699f827806 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1015.107923] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1015.108362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.108580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.108580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.108800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.108972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.109174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.109300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.109524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.109626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.109738] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.351190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6b8d784-6857-41e7-a3da-1353cee8a0c8 [ 1015.351484] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.351592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.351656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.351923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.352039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.352190] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6b8d784-6857-41e7-a3da-1353cee8a0c8 already deleted. [ 1015.352293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6b8d784-6857-41e7-a3da-1353cee8a0c8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.493370] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.493596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.494253] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.494380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.494597] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.494854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.494948] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.495241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.495421] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.495700] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.495852] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.496023] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.496170] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.496317] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.496464] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.496649] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.525596] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.525960] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.526229] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.526479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.526953] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-1672b6d4-17c1-42a4-8adb-f71f08da7d87 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.527163] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.527279] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.527612] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.527760] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1672b6d4-17c1-42a4-8adb-f71f08da7d87',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.613053] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.613053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.613053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.613053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.634484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.634778] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.634916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.635059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.635224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.635351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.635485] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1015.665434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.665678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.668061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.668061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.668061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.681383] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1016.031596] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.031806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.031934] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.032252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.033355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.033355] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 1672b6d4-17c1-42a4-8adb-f71f08da7d87 not found, creating... [ 1016.033355] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.033355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.033355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.033355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.033728] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.033902] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.034121] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.034241] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.034456] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.034903] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.034903] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 1672b6d4-17c1-42a4-8adb-f71f08da7d87 is going to be created. [ 1016.046844] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1016.047105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.047571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.047571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.047833] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.048056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.048164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.048403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.048545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.048689] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.060088] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.060367] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.060492] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.060814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.061056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.061293] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.552855] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.772981] env[65080]: INFO networking_nsxv3.common.synchronization [req-7750b3a2-ea6a-4732-a036-d9fa93a3208f req-a2eee387-60d6-40a6-aa74-52bda833f860 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1016.773634] env[65080]: INFO networking_nsxv3.common.synchronization [req-7750b3a2-ea6a-4732-a036-d9fa93a3208f req-a2eee387-60d6-40a6-aa74-52bda833f860 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1016.773634] env[65080]: INFO networking_nsxv3.common.synchronization [req-7750b3a2-ea6a-4732-a036-d9fa93a3208f req-a2eee387-60d6-40a6-aa74-52bda833f860 service nova] Enqueued Resource ID: 1672b6d4-17c1-42a4-8adb-f71f08da7d87 with Priority: HIGHEST for action port [ 1016.773949] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1016.774306] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1016.774458] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1672b6d4-17c1-42a4-8adb-f71f08da7d87 with Priority: HIGHEST for action port [ 1016.775174] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.775333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.775370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.775575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.775658] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.777394] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.777541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.777947] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1672b6d4-17c1-42a4-8adb-f71f08da7d87 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.777947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.777947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.778110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.778173] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1672b6d4-17c1-42a4-8adb-f71f08da7d87',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.847691] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1016.847945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.057758] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.145476] env[65080]: INFO networking_nsxv3.common.synchronization [req-99f679ca-981e-42d3-a263-933429d0ba72 req-8047ae63-9c1f-41bc-9319-54de537e1bbc tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 1017.146069] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGHEST for action security_group_members [ 1017.146986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.147145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.147215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.147438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.147643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.147722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.147785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.147948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.148065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.148167] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.278661] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.278889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.281367] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1672b6d4-17c1-42a4-8adb-f71f08da7d87 with status ACTIVE [ 1017.281367] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.281535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.281579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.281765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.281866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.282058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.282156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.282359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.282406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.282460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.282639] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.282744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.282807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.283138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.283138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.283138] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1672b6d4-17c1-42a4-8adb-f71f08da7d87 is going to be updated. [ 1017.309732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.309972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.310097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.310321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.310464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.310636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1672b6d4-17c1-42a4-8adb-f71f08da7d87" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.560540] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.561202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.561202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.561202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.561202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.561202] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1017.589072] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.589219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.589327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.589548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.589694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.598983] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1017.650765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.651336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.672344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.672612] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.672738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.672807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.673017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.673104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.673196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 is going to be updated. [ 1017.691920] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1017.692115] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 deletion is rescheduled due to dependency. [ 1017.692231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.692394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.692629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.692839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.692960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.693043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.693221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.693299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.693416] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.706805] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.706946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.707026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.707249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.707376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.717108] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: IN_PROGRESS for 2s [ 1018.058913] env[65080]: INFO networking_nsxv3.common.synchronization [req-081945d0-7037-4446-9bea-c5dab658c775 req-2a4cfdbb-f578-48b8-b4a3-d2539718be99 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1018.059914] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1018.060029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.060135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.060135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.060410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.060584] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.060693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.060762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.060959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.061074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.061183] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.195660] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.476589] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.476851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.476996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.477308] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.477602] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.477765] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.477929] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.478196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.478341] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.478751] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.478903] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.479126] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.479260] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.479345] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.479456] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.479911] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.504286] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.504286] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.504286] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.504286] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.504547] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.504547] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.504713] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.504998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.505136] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.563594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.563885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.563885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.564106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.564191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.564398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.564494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.564559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.564711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.564787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.565621] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 already deleted. [ 1018.565621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.700818] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.008206] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.008525] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.008590] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.008847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.008992] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.009163] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b not found, creating... [ 1019.009437] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.009595] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.009707] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.009932] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.010087] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.010369] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.010522] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.010639] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.010843] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.011076] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.011208] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b is going to be created. [ 1019.034354] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.034587] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.034685] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.034966] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.035219] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.035448] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.203579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.203826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.203905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.204111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.204461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.204461] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1019.233735] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.234567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.234767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.235195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.235513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.246328] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1019.609947] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.611362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.611362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.611750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.611750] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.728175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 in Status: SUCCESS [ 1019.728381] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 deletion is rescheduled due to dependency. [ 1019.728523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.738381] env[65080]: INFO networking_nsxv3.common.synchronization [req-081945d0-7037-4446-9bea-c5dab658c775 req-9b5fecf1-29b2-4efd-a960-7c02b822e580 service nova] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1019.738558] env[65080]: INFO networking_nsxv3.common.synchronization [req-081945d0-7037-4446-9bea-c5dab658c775 req-9b5fecf1-29b2-4efd-a960-7c02b822e580 service nova] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1019.738757] env[65080]: INFO networking_nsxv3.common.synchronization [req-081945d0-7037-4446-9bea-c5dab658c775 req-9b5fecf1-29b2-4efd-a960-7c02b822e580 service nova] Enqueued Resource ID: c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b with Priority: HIGHEST for action port [ 1019.739357] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_rules [ 1019.739513] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1019.739610] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b with Priority: HIGHEST for action port [ 1019.739927] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.742154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.742381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.742635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.742737] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.747152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.747152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.747152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.747152] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.747152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.747970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.748634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.748985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.750485] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.929469] env[65080]: INFO networking_nsxv3.common.synchronization [req-0b2bb7af-ac7b-4ef4-beb7-ff5666f4369e req-72626a96-a573-4ca4-ae47-7032fefa92dc tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1019.930104] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1019.930453] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.930599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.930684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.930933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.933460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.933460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.933460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.933460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.933460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.933460] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.113894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.114067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.114140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.114360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.114635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.114702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.114853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.115089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.115240] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.115334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.115400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.115532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.115668] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.115811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.115882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.116034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.116114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.116202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.116290] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.251249] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.251380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.251580] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.252972] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b with status ACTIVE [ 1020.253177] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.253294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.253374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.253756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.253885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.254136] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.254318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.254394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.254576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.254661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.254859] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.254956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.255029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.255212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.255245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.255348] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b is going to be updated. [ 1020.280770] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.280978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.280978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.281293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.281445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.281617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0c04a6b-2c0e-4ca2-aaac-4fad7ba9ab2b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.434301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.434943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.435088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.435430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.435578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.435965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.436110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.436180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.436364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.436452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.436550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1020.482713] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.482953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.483045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.483273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.483496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.494772] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1020.533843] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a5ade73-5a48-428c-8018-6e2e4f8877a7 req-c980f8f2-ed01-41b8-a94f-9f32ace40c4a tempest-FloatingIPsAssociationTestJSON-1173945705 tempest-FloatingIPsAssociationTestJSON-1173945705-project-member] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1020.534440] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1020.534755] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.534900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.534977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.537096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.537363] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.537528] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.541095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.541348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.541444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.541555] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.618101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 1020.638598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.638766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.638815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.639025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.639129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.639367] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.639972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.639972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.640436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.640436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.640436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.640604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.640604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.640697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.640697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.640802] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1020.753784] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.769793] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.770175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.770175] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.770464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.770739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.802102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1020.947594] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.947870] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.947996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.948501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.948625] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.948775] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.948890] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.949361] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.949549] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.949743] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.949976] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.949976] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.950082] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.950206] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.950307] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.950473] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.976655] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.976655] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.977019] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.977019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.978316] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.978316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.978316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.978316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.978316] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.043629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.043847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.043941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.044125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.044236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.044470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.044610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.044706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.044863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.044944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.045084] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 already deleted. [ 1021.045204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.256058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.256247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.256350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.256518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.256609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.256705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 is going to be created. [ 1021.259788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 4s [ 1021.283175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.283319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.283410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.283690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.284122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.294906] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: UNINITIALIZED for 2s [ 1021.481060] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.481307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.481435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.481733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.481883] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.482058] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f not found, creating... [ 1021.483052] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.483052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.483052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.483052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.483052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.483396] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.483396] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.483493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.486952] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.486952] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.486952] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f is going to be created. [ 1021.507999] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.507999] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.507999] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.508282] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.508529] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.508766] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.887946] env[65080]: INFO networking_nsxv3.common.synchronization [req-22097fed-d0cb-4bcd-bec9-c8153ea1e078 req-3c32bea7-2bf3-41dd-a5a5-9d1cff406bc1 tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1021.888555] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1021.888889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.889136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.889136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.889331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.889497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.889599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.889675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.889839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.889942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.890053] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.195183] env[65080]: INFO networking_nsxv3.common.synchronization [req-65793c6c-86f2-4af5-816a-65801607130c req-4122925b-5b0f-459b-a283-86290e375d93 tempest-ListServersNegativeTestJSON-504674289 tempest-ListServersNegativeTestJSON-504674289-project-member] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1022.195986] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGHEST for action security_group_members [ 1022.197109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.197109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.257226] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a5ade73-5a48-428c-8018-6e2e4f8877a7 req-f21f6023-620e-47db-a4dc-78830379094d service nova] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_rules [ 1022.257419] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a5ade73-5a48-428c-8018-6e2e4f8877a7 req-f21f6023-620e-47db-a4dc-78830379094d service nova] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1022.257550] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a5ade73-5a48-428c-8018-6e2e4f8877a7 req-f21f6023-620e-47db-a4dc-78830379094d service nova] Enqueued Resource ID: 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f with Priority: HIGHEST for action port [ 1022.258119] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_rules [ 1022.258817] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1022.258817] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f with Priority: HIGHEST for action port [ 1022.258817] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.259298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.259420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.261075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.261075] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.261152] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.261799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.261799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.261799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.261799] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.261799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.262084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.262120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.262217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.262338] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.263350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.263350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.263458] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.263623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.263790] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.392214] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.505812] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1022.505812] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1022.505812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.766537] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.766800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.767120] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.768303] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f with status ACTIVE [ 1022.768494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.768610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.768685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.768891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.769485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.769485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.769485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.769485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.769485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.769750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.769750] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.769983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.769983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.769983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.770172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.770172] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f is going to be updated. [ 1022.793424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.793652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.793652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.793821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.793975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.794192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45cd4fcf-5d04-47b3-8e5a-1e5f76fde62f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.827071] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1022.827284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.894434] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.971262] env[65080]: INFO networking_nsxv3.common.synchronization [None req-2cae774f-20a0-4735-a410-ab09cf02d5d6 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1022.971787] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1022.972127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.972258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.272533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1023.272774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.272987] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.274809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.274809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.274809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.275042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.275042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.276239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.276239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.276239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.276434] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.277358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.278129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.278129] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.278266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.278320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.278654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.278741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.278945] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.309329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: SUCCESS [ 1023.309728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.309728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.309991] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.310164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.310277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.310360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.310506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.310588] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.310673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.310957] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.396694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.396868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.396941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.397201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.397295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.397397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1023.427348] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.427545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.427629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.427840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.427979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.436653] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1023.778485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.778669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.778716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.778932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.779068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.779124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be created. [ 1023.780309] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.782080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.782300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.808746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.808746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.808746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.808746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.808746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.814605] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.818477] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: UNINITIALIZED for 2s [ 1024.287427] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.317694] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1f360be-120c-440f-9b3c-cb49e640a254: rpc.has_security_group_logging(os_id): False [ 1024.352329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.352611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.352611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.352868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.352868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.353159] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.353282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.353349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.353486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.353574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.353642] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 is going to be created. [ 1024.464704] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.464704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.465049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.465049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.465372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.480418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: IN_PROGRESS for 2s [ 1024.792063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.792063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.792063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.792426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.792426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.792560] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1024.830937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.830937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.830937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.830937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.830937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.848615] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1025.173810] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.174166] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.174329] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.174633] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.174970] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.175197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.175344] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.175588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.175742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.176047] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.176163] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.176322] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.176482] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.176636] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.176772] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.176926] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.204299] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.204299] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.204585] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.204665] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.205069] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.205288] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.205415] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.206501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.206694] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba511f3-5564-4d3c-8c4e-acc1664c0ed8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.449271] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1025.450306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.450306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.450455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.450529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.450937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.450937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.450937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.450937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.451102] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.649907] env[65080]: INFO networking_nsxv3.common.synchronization [None req-9a3eccd5-ee56-49d9-ba90-2a798bb2d9bf tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1025.650358] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1025.650709] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.650863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.650938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.651580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.651672] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.710269] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.710516] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.710638] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.710935] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.711106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.711266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port aba511f3-5564-4d3c-8c4e-acc1664c0ed8 not found, creating... [ 1025.711544] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.711704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.711848] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.712199] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.712360] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.712654] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.712900] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.713056] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.713267] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.713402] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.713540] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: aba511f3-5564-4d3c-8c4e-acc1664c0ed8 is going to be created. [ 1025.736072] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.736306] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.736432] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.736704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.736996] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.737258] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.836744] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1025.836744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.836982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.837244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.837535] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.837661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.837700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.838119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.838119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.838119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.838259] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.857847] env[65080]: INFO networking_nsxv3.common.synchronization [None req-4fc30a01-0435-45c3-aed9-fb2ba7c3f92e tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1025.858761] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1025.858761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.858761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.953029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.953275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.953275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.953481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.953567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.954133] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.954133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.954133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.954133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.954501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.954501] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be updated. [ 1025.986014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.986291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.986291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.987056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.987056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.997570] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: IN_PROGRESS for 2s [ 1026.166381] env[65080]: INFO networking_nsxv3.common.synchronization [req-3478211b-e155-437b-92c1-4da53afb220c req-2e9bb47f-85e3-4a16-b711-82020277f881 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1026.167027] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1026.167394] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.167538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.167620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.167857] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.168029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.168145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.168218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.168397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.168489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.168587] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.172235] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.172235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.172235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.172235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.172440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.172440] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc already deleted. [ 1026.172510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.172635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.172921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.172921] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.342087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.342087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.342087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.342087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.342531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.342633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.342633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.342871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.343037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.343182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.343329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.343762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.343762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.343762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.343988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.343988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.344139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.344346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.344346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.344569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.344643] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.487843] env[65080]: INFO networking_nsxv3.common.synchronization [req-9f80c865-463c-4236-a0b8-ece8364503da req-406324ad-7bff-4884-bb13-571d55003856 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1026.487843] env[65080]: INFO networking_nsxv3.common.synchronization [req-9f80c865-463c-4236-a0b8-ece8364503da req-406324ad-7bff-4884-bb13-571d55003856 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1026.487843] env[65080]: INFO networking_nsxv3.common.synchronization [req-9f80c865-463c-4236-a0b8-ece8364503da req-406324ad-7bff-4884-bb13-571d55003856 service nova] Enqueued Resource ID: aba511f3-5564-4d3c-8c4e-acc1664c0ed8 with Priority: HIGHEST for action port [ 1026.488378] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1026.488523] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1026.488642] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba511f3-5564-4d3c-8c4e-acc1664c0ed8 with Priority: HIGHEST for action port [ 1026.488898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.489119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.489532] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.489532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.489709] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.489709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.489841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.489917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.490180] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba511f3-5564-4d3c-8c4e-acc1664c0ed8',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.497640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: SUCCESS [ 1026.497872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.671446] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.671631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.671697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.671942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.672063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.672283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.672392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.672495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.672623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.672703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.672793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1026.696227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.696392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.696467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.696880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.696880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.696974] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc already deleted. [ 1026.697161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.706809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.707097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.707097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.707355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.707514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.722304] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1026.801119] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.801119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.801119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.801119] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.801603] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.801957] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.802227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.802589] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.802878] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.803226] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.803483] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.803799] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.804098] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.804346] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.804573] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.804809] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.828505] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.828667] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.828804] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.829827] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.829827] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-72fc4a27-7d16-4892-84d5-a47e468a510a taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.829827] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.829827] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.830275] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.830594] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72fc4a27-7d16-4892-84d5-a47e468a510a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.847321] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c50e85f-a159-417f-9f39-2a4536a3d1f9: rpc.has_security_group_logging(os_id): False [ 1026.859837] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1026.860115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.860254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.860589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.860789] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.860908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.860970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.861137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.861234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.861332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.861500] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.861584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.861636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.861774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.861907] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.862022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.862084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.862230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.862291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.862374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.862466] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.863959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.863959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.863959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.863959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.863959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.864264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.864264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.864264] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.868210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.868445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.868445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.868611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.868654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.869067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.869067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.869067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.869253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.869253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.869456] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.869526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.869596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.869750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.869848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.871260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.871260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.871826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.871826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.871826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.871826] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be created. [ 1026.958769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.958982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.959075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.959255] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.959498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.974040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1026.992554] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba511f3-5564-4d3c-8c4e-acc1664c0ed8 with status ACTIVE [ 1026.992794] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.992938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.993045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.993366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.993472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.993664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.993796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.993929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.994182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.994286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.994483] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.994575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.994711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.994834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.994885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.994990] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba511f3-5564-4d3c-8c4e-acc1664c0ed8 is going to be updated. [ 1027.021053] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.021053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.021053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.021053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.021053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.021404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba511f3-5564-4d3c-8c4e-acc1664c0ed8" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.334559] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.334830] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.334935] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.335332] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.335494] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.335670] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 72fc4a27-7d16-4892-84d5-a47e468a510a not found, creating... [ 1027.336095] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.336286] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.336425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.336711] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.337208] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.337574] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.337736] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.337855] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.338104] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.338243] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.338387] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 72fc4a27-7d16-4892-84d5-a47e468a510a is going to be created. [ 1027.364192] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.364492] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.364651] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.364978] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.365262] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.365551] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.366587] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756: rpc.has_security_group_logging(os_id): False [ 1027.367806] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.390073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.390243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.390335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.391641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.391641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.391641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.392119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.392119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.392119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.392221] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.392319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.392383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.392573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.392658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.392745] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1027.468941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.469189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.469289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.469575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.469786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.484074] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1027.870386] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.008523] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce4187d3-007a-4148-bd27-340ca7f73a61 in Status: SUCCESS [ 1028.008777] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 deletion is rescheduled due to dependency. [ 1028.008921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.096730] env[65080]: INFO networking_nsxv3.common.synchronization [req-3478211b-e155-437b-92c1-4da53afb220c req-199c0096-9eaa-4b20-9dc2-b7447cb0bfcc service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1028.096730] env[65080]: INFO networking_nsxv3.common.synchronization [req-3478211b-e155-437b-92c1-4da53afb220c req-199c0096-9eaa-4b20-9dc2-b7447cb0bfcc service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1028.098416] env[65080]: INFO networking_nsxv3.common.synchronization [req-3478211b-e155-437b-92c1-4da53afb220c req-199c0096-9eaa-4b20-9dc2-b7447cb0bfcc service nova] Enqueued Resource ID: 72fc4a27-7d16-4892-84d5-a47e468a510a with Priority: HIGHEST for action port [ 1028.099016] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1028.100035] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1028.100158] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72fc4a27-7d16-4892-84d5-a47e468a510a with Priority: HIGHEST for action port [ 1028.100459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.101637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.101740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.101912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.102008] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.105414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.107178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.107499] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-72fc4a27-7d16-4892-84d5-a47e468a510a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.107645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.107733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.107982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.108102] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72fc4a27-7d16-4892-84d5-a47e468a510a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.374058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.374231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.374307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.374527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.374673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.374713] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1028.401424] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.401628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.401628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.401814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.401986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.411359] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1028.605541] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.605712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.610160] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72fc4a27-7d16-4892-84d5-a47e468a510a with status ACTIVE [ 1028.610514] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.610675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.610743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.610962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.611104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.611345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.611405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.611492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.611636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.611716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.611918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.612033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.612172] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.612357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.612440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.612526] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72fc4a27-7d16-4892-84d5-a47e468a510a is going to be updated. [ 1028.635712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.635939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.636016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.636302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.636465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.636645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72fc4a27-7d16-4892-84d5-a47e468a510a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.733512] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1028.733713] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1028.733851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.734067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.734267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.734469] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.734606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.734701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.734899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.735012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.735092] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.985849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1028.986240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.238232] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.504790] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1029.504790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.504790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.504790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.504790] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.743227] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.009492] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.009781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.246633] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.246633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.246633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.248445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.248445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.248445] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1030.277945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.278167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.278167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.278461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.278614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.290404] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1030.425981] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.425981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.425981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.425981] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.931822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.931822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.931822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.931822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.932673] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.932673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.932951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.932951] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.435265] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756: rpc.has_security_group_logging(os_id): False [ 1031.454414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.454582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.454909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.454909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.455085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.455415] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.455415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.455553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.455724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.455724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.455961] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.456510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.456679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.456774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.456880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.457153] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.457292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.457364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.457558] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.457621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.457671] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1031.595355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.595355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.595560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.595701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.595760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.625182] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1031.719221] env[65080]: INFO networking_nsxv3.common.synchronization [req-e885ebee-7428-45bf-9a2f-c65f964f3643 req-8fcffecc-1958-40f2-96c8-0892851a16ca tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1031.720142] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1031.720507] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.720642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.720724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.720954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.721138] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.721247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.721318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.721481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.721569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.721676] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.224854] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.224854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.224854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.225211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.225211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.226028] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.226028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.226028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.226028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.226266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.226266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1032.260213] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.260213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.260213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.260213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.260499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.271997] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1032.300678] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1032.300915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.301229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.301369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.301582] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.301706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.301772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.301951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.302046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.302134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.302241] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.804643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.804971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.804971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.805325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.805550] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.805630] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.805677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.805839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.806596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.806596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.806892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.806892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.806892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.807029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.807029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.807104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.807241] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.310125] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d: rpc.has_security_group_logging(os_id): False [ 1033.336334] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.336477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.336573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.336797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.336893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.337132] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.337213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.337276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.337431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.337510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.337727] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.337846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.337912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.338072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.338151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.338429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.338523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.338585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.338722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.338809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.338895] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1033.433834] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.433995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.434142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.434427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.434491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.457117] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1033.643628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1033.643914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.285380] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1034.285380] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 deletion is rescheduled due to dependency. [ 1034.285380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.350280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.350425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.350539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.350705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.854673] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.359210] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.475038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1035.475491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.860605] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1035.860723] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1036.720864] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1036.721177] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1036.892987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.892987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.892987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.892987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.904798] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1036.905760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.907096] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1036.950248] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.950469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.950469] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.950658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.961349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.962141] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1036.962219] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1036.962308] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1037.010129] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.010385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.010385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.010529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.012049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.012263] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1037.141116] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.141335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.141335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.141482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.141789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.142102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1037.262567] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.262567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.262567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.263408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.263408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.263560] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1037.263560] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f218e741-66ae-4212-b505-022023a657a5', '69bf0a4d-c007-4a2a-a34e-6cb212b0693e', 'ce4187d3-007a-4148-bd27-340ca7f73a61', '379c83f4-3ef4-4263-aff5-1c9a7750a19a', '3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00', 'd0ec527d-b1df-4719-9613-729c01dff53d', '66ac16de-c17b-4005-aa11-407133216460', 'cdf55eea-7c35-4863-963a-9034c2b5fa2d', '5c05ac33-707c-472e-b683-3c9cbb9a919b', 'c3269206-fb2c-48bf-b03a-c5065b747a8c', '1ab0447d-1533-4bb0-a280-31ec2fa0ff60', '7a859d56-1200-4947-a281-afd910811864', '69af222b-9d8b-4146-9ffa-942af2d8c839', '0c50e85f-a159-417f-9f39-2a4536a3d1f9', 'a0bed36f-2ea1-4c82-9859-63ef0d32d194', '4fdd5826-7c9a-4cc6-a81b-59df4cf76173', '1b61ca41-342a-486f-b32c-2246f071cb26', 'a1f360be-120c-440f-9b3c-cb49e640a254', 'c08a0238-d0a8-47ca-b018-8c7d44286412', '97754e94-da90-4f7b-8c52-b6ebac93d80e', '78fc59d1-2dfd-4052-b838-ea0677bb6950', '30779562-35b9-47db-9f9a-0150e8c2a1fc', '63c7032c-d9d0-44bc-a95a-298729548f78', '74ec0c67-3f18-478e-834a-86d63bd247dc', '6825ea0a-b872-4921-b4ff-cfadbcf5f615', '354ecbf4-79a8-4770-9da4-7284d1f205e7', 'ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d', '5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0', 'f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f', '8ff651ba-db91-4903-b7c9-61210ba27bf2', '65229547-ee66-4305-8bfe-45dde2354faf', '05b95378-31e5-4020-807b-04d9b89c292b', '9e59560e-07cb-4010-9db4-01e08b7a2a6f', '2314d2a9-c4bd-47c8-8042-e43fbe76d252', 'defc6278-7bc8-46f9-a983-ce92624f663f', 'a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957', '409c4860-3410-423b-b6d1-e6ef10d36332', '139f1c3c-a779-4214-88d4-1b7cd2dfa63a', '9f26b803-17d9-4a38-b02c-de9324967417', 'bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756', 'f37e842d-6cd4-418f-bbf9-d080ba3516d1', 'b73fffa1-5944-4b18-a4a3-4524859f2a56', '469659aa-55ee-4417-af33-cbcc618456d1', '1f5d56a6-c880-45fc-9906-c91296be3017', '368f5d0c-dc76-4d4f-b69c-1d60821659c2', 'e64e7d9f-cf01-4bec-a794-828cbbadc52e'} {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.263924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1037.288373] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.288664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.288799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.288972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.289080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.289199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1037.289275] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.289344] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1037.384100] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.384313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.384596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.384596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.385935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.385935] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1037.386161] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.386161] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1037.386253] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1037.386253] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1037.386333] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGH for action security_group_rules [ 1037.386411] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGH for action security_group_rules [ 1037.386476] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGH for action security_group_rules [ 1037.386619] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGH for action security_group_rules [ 1037.386619] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGH for action security_group_rules [ 1037.386698] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 1037.386698] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGH for action security_group_rules [ 1037.386772] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGH for action security_group_rules [ 1037.386878] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGH for action security_group_rules [ 1037.386878] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGH for action security_group_rules [ 1037.386963] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGH for action security_group_rules [ 1037.387031] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGH for action security_group_rules [ 1037.387070] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGH for action security_group_rules [ 1037.387117] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGH for action security_group_rules [ 1037.387168] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGH for action security_group_rules [ 1037.387232] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGH for action security_group_rules [ 1037.387285] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGH for action security_group_rules [ 1037.387346] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGH for action security_group_rules [ 1037.387403] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGH for action security_group_rules [ 1037.387453] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGH for action security_group_rules [ 1037.387592] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.666176] env[65080]: INFO networking_nsxv3.common.synchronization [req-7dddfb78-da0b-4cd9-ae0b-d79181887be7 req-475af83c-28e5-4499-aee8-02200ee283d2 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1037.666936] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1037.667043] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGH for action security_group_rules [ 1037.667165] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4187d3-007a-4148-bd27-340ca7f73a61 with Priority: HIGH for action security_group_rules [ 1037.667489] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGH for action security_group_rules [ 1037.667489] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 with Priority: HIGH for action security_group_rules [ 1037.667679] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e with Priority: HIGH for action security_group_rules [ 1037.667679] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a0238-d0a8-47ca-b018-8c7d44286412 with Priority: HIGH for action security_group_rules [ 1037.667753] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGH for action security_group_rules [ 1037.667872] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b61ca41-342a-486f-b32c-2246f071cb26 with Priority: HIGH for action security_group_rules [ 1037.667934] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGH for action security_group_rules [ 1037.668044] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGH for action security_group_rules [ 1037.668308] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 with Priority: HIGH for action security_group_rules [ 1037.668308] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a859d56-1200-4947-a281-afd910811864 with Priority: HIGH for action security_group_rules [ 1037.668422] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 with Priority: HIGH for action security_group_rules [ 1037.668467] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3269206-fb2c-48bf-b03a-c5065b747a8c with Priority: HIGH for action security_group_rules [ 1037.670731] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b with Priority: HIGH for action security_group_rules [ 1037.671193] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 1037.671193] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGH for action security_group_rules [ 1037.671193] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 with Priority: HIGH for action security_group_rules [ 1037.671193] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGH for action security_group_rules [ 1037.671487] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a with Priority: HIGH for action security_group_rules [ 1037.671615] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.671751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.671830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.672035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.672370] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.672370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.672370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.672522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.672609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.672711] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.674140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.674140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.674140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.674140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.674140] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.675348] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce4187d3-007a-4148-bd27-340ca7f73a61 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.675348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.675348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.675348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.675348] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce4187d3-007a-4148-bd27-340ca7f73a61',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.678285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.678285] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.678285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.678285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.678285] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bed36f-2ea1-4c82-9859-63ef0d32d194',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.678715] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97754e94-da90-4f7b-8c52-b6ebac93d80e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.678715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.678715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.678829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.678907] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97754e94-da90-4f7b-8c52-b6ebac93d80e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.679590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c08a0238-d0a8-47ca-b018-8c7d44286412 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.679691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.680878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.680878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.680878] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c08a0238-d0a8-47ca-b018-8c7d44286412',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.680992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.682077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.682077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.682077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.682077] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.682535] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b61ca41-342a-486f-b32c-2246f071cb26 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.682535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.682535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.682535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.682535] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b61ca41-342a-486f-b32c-2246f071cb26',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.683687] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.683687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.683687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.683687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.683687] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.684665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.684665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.684836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.684836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.684908] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.685605] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69af222b-9d8b-4146-9ffa-942af2d8c839 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.686250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.686250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.686250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.686250] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69af222b-9d8b-4146-9ffa-942af2d8c839',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.687143] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a859d56-1200-4947-a281-afd910811864 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.687143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.687143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.687143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.687432] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a859d56-1200-4947-a281-afd910811864',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.687878] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.687980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.688118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.688187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.688261] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab0447d-1533-4bb0-a280-31ec2fa0ff60',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.688922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3269206-fb2c-48bf-b03a-c5065b747a8c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.689254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.689254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.689428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.689428] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3269206-fb2c-48bf-b03a-c5065b747a8c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.690442] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c05ac33-707c-472e-b683-3c9cbb9a919b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.690936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.690936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.691047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.691047] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c05ac33-707c-472e-b683-3c9cbb9a919b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.691930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.691930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.691930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.692329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.692329] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.693885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.693885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.693885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.693885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.693885] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.694213] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.694213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.694213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.694371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.694371] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.695148] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.695148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.695300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.695365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.695415] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.696315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.696315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.696315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.696477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.696549] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('379c83f4-3ef4-4263-aff5-1c9a7750a19a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.087790] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088632] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.089292] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.089738] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.090072] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.090329] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.090684] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.090950] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.091400] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.092959] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.092959] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.092959] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.092959] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.092959] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.092959] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.113671] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.113867] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.114683] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.114683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.114839] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-e22e7cf0-9021-4c77-a708-cb05bcfc02de taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.114958] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.115087] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.115425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.115573] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e22e7cf0-9021-4c77-a708-cb05bcfc02de',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.198837] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.199081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.199158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.199451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.199601] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.199832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.199832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.200077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.200168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.200241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.200297] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.201432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.201632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.201632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.201923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.201979] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.202154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.202223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.202357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.202626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.202626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.203024] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.214038] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.217210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.217210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.217210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.217505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.217648] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.217752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.217816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.218062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.218185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.218250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.218368] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.222182] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.222182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.222182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.222517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.222517] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.222609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.222609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.222817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.222817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.222913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.223035] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.223941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.224081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.224141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.224269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.224416] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.224538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.224599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.224701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.224881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.224881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.224953] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.225821] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.225927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.226203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.226203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.226943] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.227115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.227157] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.227279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.227363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.227492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.227550] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.308513] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.308830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.308830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.309038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.312205] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.312205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.312205] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.312372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.313122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.313238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.315298] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.315402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.316319] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.316430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.318331] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.318433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.322887] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.322887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.326028] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.326028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.336195] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.336368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.337378] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.337378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.337979] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.338447] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.338559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.339306] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.339661] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.339791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.340353] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.340752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.340852] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00 is going to be deleted. [ 1038.341893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.341986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.344275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.344275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.373717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.373879] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97754e94-da90-4f7b-8c52-b6ebac93d80e is going to be deleted. [ 1038.374903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.375159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.399479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.399479] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be deleted. [ 1038.400828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.400828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.418611] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.418716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.426713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.428509] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3269206-fb2c-48bf-b03a-c5065b747a8c is going to be deleted. [ 1038.428509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.428509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.444570] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.444815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.455049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.456311] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 379c83f4-3ef4-4263-aff5-1c9a7750a19a is going to be deleted. [ 1038.457786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.457990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.491212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.491371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab0447d-1533-4bb0-a280-31ec2fa0ff60 is going to be deleted. [ 1038.492333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.492639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.597445] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.597733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.618568] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.618930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.619060] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.620406] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.620571] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.620738] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port e22e7cf0-9021-4c77-a708-cb05bcfc02de not found, creating... [ 1038.621089] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.621313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.621437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.621695] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.621852] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.622186] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.622346] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.622564] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.622684] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.622820] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.622961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: e22e7cf0-9021-4c77-a708-cb05bcfc02de is going to be created. [ 1038.655514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.655692] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be deleted. [ 1038.657027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.657195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.660743] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.660950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.691290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.691499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.709405] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.709629] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.709795] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.710085] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.710334] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.710582] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.711537] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.712334] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.723418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.723582] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c08a0238-d0a8-47ca-b018-8c7d44286412 is going to be deleted. [ 1038.724638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.724754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.738567] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.740921] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.740921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.740921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.741262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.741467] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.741618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.741717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.741942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.742088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.742222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.742469] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.742563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.742652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.742855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.743076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.743243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.743303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.743496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.743612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.743736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.743867] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.745073] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.746784] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.749313] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0ec527d-b1df-4719-9613-729c01dff53d: rpc.has_security_group_logging(os_id): False [ 1038.751523] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.778976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.779254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.791932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.791932] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b61ca41-342a-486f-b32c-2246f071cb26 is going to be deleted. [ 1038.792694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.792926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.805037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.805211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.846333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.846563] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c05ac33-707c-472e-b683-3c9cbb9a919b is going to be deleted. [ 1038.848063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.848418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.890150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.890368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.936675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.936952] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a859d56-1200-4947-a281-afd910811864 is going to be deleted. [ 1038.939797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.940407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.945347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.945632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.962894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.963061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.990902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.991014] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bed36f-2ea1-4c82-9859-63ef0d32d194 is going to be deleted. [ 1038.991994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.992847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.018040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.018040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.018886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.019069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce4187d3-007a-4148-bd27-340ca7f73a61 is going to be deleted. [ 1039.020285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.020285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.090202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.090625] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69af222b-9d8b-4146-9ffa-942af2d8c839 is going to be deleted. [ 1039.091929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.092295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.092455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.092617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a767ba7-7bf3-49ac-95f6-c55d1d6d2b00" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.092793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.093025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.093152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.093322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97754e94-da90-4f7b-8c52-b6ebac93d80e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.094071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3269206-fb2c-48bf-b03a-c5065b747a8c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.095697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-379c83f4-3ef4-4263-aff5-1c9a7750a19a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.096308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.097037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.097037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.097206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab0447d-1533-4bb0-a280-31ec2fa0ff60" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.097300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.097491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.167535] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.167535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.177031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.177031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.177031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.177031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.177031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.177031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.177031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1039.178454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.179150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.179481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.180070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.180619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.180772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.181191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.181787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c08a0238-d0a8-47ca-b018-8c7d44286412" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.183030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.183814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.183814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.183814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.184194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.184895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bed36f-2ea1-4c82-9859-63ef0d32d194" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b61ca41-342a-486f-b32c-2246f071cb26" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c05ac33-707c-472e-b683-3c9cbb9a919b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a859d56-1200-4947-a281-afd910811864" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.197891] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.198836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.198836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.199760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.199760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.200848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce4187d3-007a-4148-bd27-340ca7f73a61" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.218053] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf55eea-7c35-4863-963a-9034c2b5fa2d: rpc.has_security_group_logging(os_id): False [ 1039.218783] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69bf0a4d-c007-4a2a-a34e-6cb212b0693e: rpc.has_security_group_logging(os_id): False [ 1039.251543] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1f360be-120c-440f-9b3c-cb49e640a254: rpc.has_security_group_logging(os_id): False [ 1039.252881] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c50e85f-a159-417f-9f39-2a4536a3d1f9: rpc.has_security_group_logging(os_id): False [ 1039.254235] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66ac16de-c17b-4005-aa11-407133216460: rpc.has_security_group_logging(os_id): False [ 1039.255377] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.255526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.255614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.255820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.255929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.256184] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1039.258771] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.258937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.258984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.259226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.260848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.261020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.307405] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.307591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.309848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.310025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.314400] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.314560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.325536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.325536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.327186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.327186] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.327409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.327409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.331022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.331022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.331022] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1039.331022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.331022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.383658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.384659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.384659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.384659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.384659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.384659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.385289] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e is going to be updated. [ 1039.386452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.387733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.410984] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.411176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.411518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.411518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.411738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.422030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.422030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.431717] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1039.452777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.453167] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.453300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.453367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.453616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.453715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.453817] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 is going to be updated. [ 1039.455173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.455280] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.455386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.455560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69af222b-9d8b-4146-9ffa-942af2d8c839" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.455667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.455841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [req-7dddfb78-da0b-4cd9-ae0b-d79181887be7 req-6fdb62c6-a672-49e4-9bd4-737eec7a6ee5 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [req-7dddfb78-da0b-4cd9-ae0b-d79181887be7 req-6fdb62c6-a672-49e4-9bd4-737eec7a6ee5 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [req-7dddfb78-da0b-4cd9-ae0b-d79181887be7 req-6fdb62c6-a672-49e4-9bd4-737eec7a6ee5 service nova] Enqueued Resource ID: e22e7cf0-9021-4c77-a708-cb05bcfc02de with Priority: HIGHEST for action port [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1039.509678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e22e7cf0-9021-4c77-a708-cb05bcfc02de with Priority: HIGHEST for action port [ 1039.510306] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.510306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.510446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.510672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.510832] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.513322] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.513547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.513844] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e22e7cf0-9021-4c77-a708-cb05bcfc02de taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.514020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.514115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.514440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.514440] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e22e7cf0-9021-4c77-a708-cb05bcfc02de',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.520494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.520653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.522297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.522832] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.522832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.523094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.523594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.523847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.523847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.524037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.524386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.524386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.524481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.524734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.524734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.524948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.525024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1039.526505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.526753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.527159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.528040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.528238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.556274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.556677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.583250] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1039.603676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.603828] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.604129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.604294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.604476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.604571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.605201] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ac16de-c17b-4005-aa11-407133216460 is going to be updated. [ 1039.606138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.606376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.606543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.607856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.608143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.608308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.621957] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.622187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.622240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.622593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.622784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.629226] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: IN_PROGRESS for 2s [ 1039.653596] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1039.653869] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: IN_PROGRESS for 2s [ 1039.766956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.767165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.767209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.767428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.767573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.794110] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.794365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.794455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.794790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.795049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.815180] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1039.820244] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.820628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: IN_PROGRESS for 2s [ 1040.017644] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.017644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.017644] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e22e7cf0-9021-4c77-a708-cb05bcfc02de with status ACTIVE [ 1040.018903] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.018903] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.018903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.019343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.019343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.019343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.019454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.019593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.019658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.019730] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e22e7cf0-9021-4c77-a708-cb05bcfc02de is going to be updated. [ 1040.043784] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.043926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.044050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.044268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.044662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.044875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e22e7cf0-9021-4c77-a708-cb05bcfc02de" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.345150] env[65080]: INFO networking_nsxv3.common.synchronization [req-5bdfb199-dc71-4851-9632-89ebabfea714 req-5a9a1301-9525-4fcb-8fb9-e4914e48ce24 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1040.345638] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1040.346441] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.346728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.346728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.347058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.347399] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.347513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.347690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.347757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.347840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.348024] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.580793] env[65080]: INFO networking_nsxv3.common.synchronization [req-cf7451d1-bf9c-4ec8-8226-f7228a23dff9 req-bf7f2a7a-218a-42d7-b017-85f469ce0e17 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1040.581868] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1040.581868] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.581868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.581868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.582451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.582644] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.582746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.582813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.582992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.583092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.583194] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.672227] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.672423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.672542] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.672810] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.673102] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.674435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.674435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.674435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.674435] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.674435] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.674435] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.674435] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.675457] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.675594] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.675717] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.675859] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.705534] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.705670] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.705845] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.706248] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.706498] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.706679] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.706810] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.707609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.707609] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c04202-ab2c-4a3e-b58b-6a8bb0a946cb',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.850841] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.851071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.851071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.851320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.851414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.851630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.852097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.852173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.852372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.852566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.852566] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc already deleted. [ 1040.852709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.085824] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.209470] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.209709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.209781] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.210578] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.210578] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.210578] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb not found, creating... [ 1041.210578] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.211019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.211019] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.211172] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.211278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.211457] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.211609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.211719] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.211960] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.212105] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.212241] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb is going to be created. [ 1041.233969] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.234273] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.234414] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.234689] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.234916] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.235152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.444851] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1041.445263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.445689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.445839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.446222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.446421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.446541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.446767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.446917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.447180] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.591913] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.621839] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1041.622080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.654331] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: SUCCESS [ 1041.654665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.659025] env[65080]: INFO networking_nsxv3.common.synchronization [None req-2dba8910-1a43-43d6-81a9-75396460e797 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1041.660443] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1041.660819] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.660929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.682464] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1041.682691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.683500] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: SUCCESS [ 1041.683679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.830281] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1041.830667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.831577] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: SUCCESS [ 1041.831811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.949835] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.970741] env[65080]: INFO networking_nsxv3.common.synchronization [req-5bdfb199-dc71-4851-9632-89ebabfea714 req-ec796260-16b0-4eed-ad29-991fbeea8801 service nova] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1041.973098] env[65080]: INFO networking_nsxv3.common.synchronization [req-5bdfb199-dc71-4851-9632-89ebabfea714 req-ec796260-16b0-4eed-ad29-991fbeea8801 service nova] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1041.973098] env[65080]: INFO networking_nsxv3.common.synchronization [req-5bdfb199-dc71-4851-9632-89ebabfea714 req-ec796260-16b0-4eed-ad29-991fbeea8801 service nova] Enqueued Resource ID: 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb with Priority: HIGHEST for action port [ 1041.973098] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_rules [ 1041.973098] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1041.973098] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb with Priority: HIGHEST for action port [ 1041.973098] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.973098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.973098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.973098] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.973717] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.973856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.974122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.974313] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.974594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.975505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.975794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.975794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.975889] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.976684] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.976798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.976864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.977011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.977089] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c04202-ab2c-4a3e-b58b-6a8bb0a946cb',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.097219] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.097219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.097219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.097219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.097219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.097219] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1042.127470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.127470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.127470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.127470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.127470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.136362] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1042.452755] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.479264] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.479654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.480958] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.480958] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb with status ACTIVE [ 1042.481260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.481260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.481260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.481398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.481488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.481659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.481755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.482286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.482286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.482286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.482286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.482286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.482532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.482532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.482607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.482650] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10c04202-ab2c-4a3e-b58b-6a8bb0a946cb is going to be updated. [ 1042.505191] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.505360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.505425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.505596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.505728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.505884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10c04202-ab2c-4a3e-b58b-6a8bb0a946cb" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.955087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.955087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.955297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.955373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.955461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.955562] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1042.985685] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.987665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.987820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.987893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.988070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.988211] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.998258] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1043.490740] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.491124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.491124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.491322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.491386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.491446] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc is going to be created. [ 1043.531790] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.532028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.532028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.532236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.532421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.545163] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: UNINITIALIZED for 2s [ 1044.138980] env[65080]: INFO networking_nsxv3.common.synchronization [None req-1b31f3ae-1a02-40d0-af0d-19b205f1fee1 tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f with Priority: HIGHEST for action security_group_rules [ 1044.139817] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f with Priority: HIGHEST for action security_group_rules [ 1044.140331] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.140531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.140531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.140899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.140899] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ac1d78-d8ef-4d89-bb27-3632023e5d8f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.148597] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1044.151210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.151210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.151210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.151210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.151210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.151430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.151463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.151551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.151678] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.266393] env[65080]: INFO networking_nsxv3.common.synchronization [None req-573c892e-91ed-42e9-8ad2-7a4009254ee4 tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f with Priority: HIGHEST for action security_group_rules [ 1044.267305] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f with Priority: HIGHEST for action security_group_rules [ 1044.267435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.267435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.655482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.656162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.656162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.656506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.663978] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.664219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.679410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.679682] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.679817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.679973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.680075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.680176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.680255] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1044.681252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.681426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.681501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.681595] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f already deleted. [ 1044.681698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.681829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.681976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.682184] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ac1d78-d8ef-4d89-bb27-3632023e5d8f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.721382] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.721550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.721629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.721876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.722060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.732208] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1045.010999] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1045.011518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.011518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.012057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.012057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.012203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.012240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.012382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.012451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.012540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.012634] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.205263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.205443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.205443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.206119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.206119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.206119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ac1d78-d8ef-4d89-bb27-3632023e5d8f already deleted. [ 1045.206119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ac1d78-d8ef-4d89-bb27-3632023e5d8f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.346165] env[65080]: INFO networking_nsxv3.common.synchronization [req-d9b48a8a-1f5e-48a2-90f2-d67c4f97fb79 req-bd3ed04d-2021-46d0-a619-0d2ee40c27a3 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 1045.346165] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGHEST for action security_group_members [ 1045.346605] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.346964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.348792] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.348792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.348792] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.516766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.516899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.516984] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.517233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.517410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.517515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.517578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.517737] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.518453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.518621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.518801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.518909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.518976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.519155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.519305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.519400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.519461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.519601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.519680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.519765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.519854] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.555340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: SUCCESS [ 1045.555340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.555340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.555562] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.555673] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.555892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.555892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.556034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.556101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.556264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.556325] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.852634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.855278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.855622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.856178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.884015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.885475] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.885639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.886499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.886499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.886499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.886499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc is going to be updated. [ 1045.922524] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.922524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.922524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.922524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.922524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.932707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: IN_PROGRESS for 2s [ 1046.023808] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 1046.045035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.045213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.045303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.045515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.058890] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.070730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.070730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.070730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.070730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.070730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.071111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.071111] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.071111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.071111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.071343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.071420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.071625] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.072049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.072131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.072302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.072385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.072570] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1046.144726] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.146270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.146270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.146270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.146270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.166102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1046.561558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a362f529-f360-4ab1-9a78-44dfdf9ddecc: rpc.has_security_group_logging(os_id): False [ 1046.590347] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.590501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.590575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.590781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.590872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.591131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.591238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.591291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.591434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.591499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.591604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc is going to be created. [ 1046.640832] env[65080]: INFO networking_nsxv3.common.synchronization [req-faf705da-eb8f-42cb-8787-ef58245a6b3b req-a73e508e-2f52-4519-8a8f-2e57cd83ce28 tempest-FloatingIPsAssociationTestJSON-1173945705 tempest-FloatingIPsAssociationTestJSON-1173945705-project-member] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1046.640832] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1046.641052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.641119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.641164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.641366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.641518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.641616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.641961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.641961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.641961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.642130] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.654065] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.654240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.654317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.654476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.654933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.670778] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: IN_PROGRESS for 2s [ 1046.746572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1046.746731] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 deletion is rescheduled due to dependency. [ 1046.746870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.983225] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.983652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.983652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.983858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.984805] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.985103] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.985395] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.985395] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.985541] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.985780] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.985903] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.986380] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.986380] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.986380] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1046.986493] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.986543] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.007721] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.007966] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.008037] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.008205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-221" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.008529] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.008711] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.008812] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.009167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.009310] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c2b70a-67d8-4a49-96e4-f8f1a0298860',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.143880] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.516208] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.516487] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.516676] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.516913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.517070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.517298] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c5c2b70a-67d8-4a49-96e4-f8f1a0298860 not found, creating... [ 1047.517640] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.518026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.518026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.518183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.518324] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.518612] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.518766] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.518877] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.519139] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.519299] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.519499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c5c2b70a-67d8-4a49-96e4-f8f1a0298860 is going to be created. [ 1047.542490] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.542772] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.542905] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.543249] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.543491] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.543722] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.646034] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.943336] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74ec0c67-3f18-478e-834a-86d63bd247dc in Status: SUCCESS [ 1047.943441] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc deletion is rescheduled due to dependency. [ 1047.944933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.149059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.149439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.149439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.149526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.149617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.149809] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1048.191885] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1048.191885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.193210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.193385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.193772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.193772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.193915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.203322] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1048.273642] env[65080]: INFO networking_nsxv3.common.synchronization [req-faf705da-eb8f-42cb-8787-ef58245a6b3b req-e56bf679-ee0b-4c8f-bf6f-7b3a90cd4a85 service nova] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_rules [ 1048.273775] env[65080]: INFO networking_nsxv3.common.synchronization [req-faf705da-eb8f-42cb-8787-ef58245a6b3b req-e56bf679-ee0b-4c8f-bf6f-7b3a90cd4a85 service nova] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1048.273864] env[65080]: INFO networking_nsxv3.common.synchronization [req-faf705da-eb8f-42cb-8787-ef58245a6b3b req-e56bf679-ee0b-4c8f-bf6f-7b3a90cd4a85 service nova] Enqueued Resource ID: c5c2b70a-67d8-4a49-96e4-f8f1a0298860 with Priority: HIGHEST for action port [ 1048.274442] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_rules [ 1048.274584] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1048.274677] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c2b70a-67d8-4a49-96e4-f8f1a0298860 with Priority: HIGHEST for action port [ 1048.274963] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.275328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.275445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277054] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.277201] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.277318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.277622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.277677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.277841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.277917] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c2b70a-67d8-4a49-96e4-f8f1a0298860',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.682649] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: SUCCESS [ 1048.682871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.778264] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.778590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.779781] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5c2b70a-67d8-4a49-96e4-f8f1a0298860 with status ACTIVE [ 1048.779972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.780133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.780191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.780394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.780495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.780674] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.780802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.780856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.780976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.781077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.781243] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.781335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.781386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.781531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.781590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.781673] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5c2b70a-67d8-4a49-96e4-f8f1a0298860 is going to be updated. [ 1048.803655] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.803874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.803874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.804099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.804245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.804409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5c2b70a-67d8-4a49-96e4-f8f1a0298860" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.489269] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.489269] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.489269] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.489700] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.489700] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.489867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.489987] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.490231] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.490378] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.490587] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.490698] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.490806] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.490912] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.491047] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.491154] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.491283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.510406] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.510621] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.510783] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.510956] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.511276] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-db981f00-ad0d-40db-9a46-b1f9208d0e5b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.511447] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.511564] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.511813] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.511947] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db981f00-ad0d-40db-9a46-b1f9208d0e5b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.014489] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.014742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.014845] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.015165] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.015371] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.015618] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.015750] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.015871] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.016094] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.016264] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.016537] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.016692] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.017070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.017070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.017196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.017336] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b is going to be updated. [ 1050.039925] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.040270] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.040371] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.040697] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.040892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.041132] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.215213] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1050.216378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.216456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.216956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.217284] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.217773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.217773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.217773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.218068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.218261] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.720845] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.782349] env[65080]: INFO networking_nsxv3.common.synchronization [req-7fcd0d8c-d0c6-4ab9-b6e8-1af2b924eed8 req-c6bc2b01-f7d8-47f2-a939-a78651f8578f tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1050.782349] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1050.782349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.782349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.782349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.782574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.782574] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.782704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.782748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.782911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.782999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.783108] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.798121] env[65080]: INFO networking_nsxv3.common.synchronization [req-9d6f7573-0daa-4e6b-b6ba-18f328e0cf12 req-0c14ac47-af19-4da4-bc18-2142cd944deb service nova] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 1050.798564] env[65080]: INFO networking_nsxv3.common.synchronization [req-9d6f7573-0daa-4e6b-b6ba-18f328e0cf12 req-0c14ac47-af19-4da4-bc18-2142cd944deb service nova] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 1050.798564] env[65080]: INFO networking_nsxv3.common.synchronization [req-9d6f7573-0daa-4e6b-b6ba-18f328e0cf12 req-0c14ac47-af19-4da4-bc18-2142cd944deb service nova] Enqueued Resource ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b with Priority: HIGHEST for action port [ 1050.799984] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_rules [ 1050.800234] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 1050.800351] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b with Priority: HIGHEST for action port [ 1050.802018] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.802236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.802329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.802512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.802574] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.803500] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.803685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.803685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.803835] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.803984] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.804287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.804362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.804552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.804606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.804715] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.805864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-db981f00-ad0d-40db-9a46-b1f9208d0e5b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.805983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.806061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.807083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.807083] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db981f00-ad0d-40db-9a46-b1f9208d0e5b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.223721] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.285119] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.309986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.310107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.310293] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db981f00-ad0d-40db-9a46-b1f9208d0e5b with status ACTIVE [ 1051.310529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.310616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.310691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.310964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.311073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.311263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.311362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.311540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.311582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.311662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.311817] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.311974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.311974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.312147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.312206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.312373] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db981f00-ad0d-40db-9a46-b1f9208d0e5b is going to be updated. [ 1051.313394] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.334011] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.334181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.334250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.334483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.334591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.334751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db981f00-ad0d-40db-9a46-b1f9208d0e5b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.727059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.727556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.727556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.727633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.727683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.727967] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1051.763662] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.763871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.763951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.764276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.764494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.777394] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1051.787919] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.816321] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.290681] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.290896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.290941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.291307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.291488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.291598] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1052.320087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.320310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.320310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.320495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.320625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.320681] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be updated. [ 1052.346503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.346988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.346988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.348034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.348034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.359973] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1052.366643] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.366850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.366959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.367127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.367413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.378096] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: IN_PROGRESS for 2s [ 1053.787731] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1053.788034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.788314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.788465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.788895] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.788895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.788895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.789134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.789194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.789285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.789389] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.291767] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.291929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.292044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.292646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.292646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.292646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.292646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.292912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.292996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.293115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.293292] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.293451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.293505] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.293632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.293773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.293987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.293987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.294109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.294174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.294301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.294375] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.372694] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1054.372930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.388854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: SUCCESS [ 1054.389112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.389281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.389579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.389872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.390074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.390166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.390318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.390407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.390573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.390680] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.798897] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c50e85f-a159-417f-9f39-2a4536a3d1f9: rpc.has_security_group_logging(os_id): False [ 1054.817122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.817339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.817410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.817629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.817715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.817944] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.818056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.818118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.818263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.818342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.818521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.818670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.818773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.818816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.818893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.819115] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.819212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.819212] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.819353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.819406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.819533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1054.881826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.881996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.882054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.882498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.882707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.893645] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.898032] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1055.395892] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fdd5826-7c9a-4cc6-a81b-59df4cf76173: rpc.has_security_group_logging(os_id): False [ 1055.413485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.413703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.413703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.413890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.413980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.414250] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.414448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.414448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.414564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.414642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.414729] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be created. [ 1055.479497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.479699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.479699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.479908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.480102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.494294] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: IN_PROGRESS for 2s [ 1055.800966] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1055.801403] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1056.911858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1056.912612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.508600] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: SUCCESS [ 1057.508824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.948997] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6d45fdb3-ad4e-4b1b-9bce-6a9b9564502c tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1059.949949] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1059.950169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.950317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.950410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.950657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.950742] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.085720] env[65080]: INFO networking_nsxv3.common.synchronization [None req-aca15f80-fcc4-467d-bac9-b0fe5d35092d tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1060.086747] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1060.087563] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.087563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.476233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.476479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.476596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.477287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.477401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.478186] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 already deleted. [ 1060.478186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.478186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.478186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.478186] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.001645] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.001645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.001645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.001645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.002138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.002138] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 already deleted. [ 1061.002138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.593901] env[65080]: INFO networking_nsxv3.common.synchronization [req-5dcf19f8-6976-4672-8af7-43aaa12fbf06 req-854b6fd6-1cc3-461b-9301-2e05ae151511 tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1061.594435] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1061.594754] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.594878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.594946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.595271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.595370] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.595425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.595461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.596090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.596090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.596090] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.041675] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.041675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.041675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.041675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.042360] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.042360] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.042657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.042657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.042833] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.042973] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.043103] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.043561] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.043561] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.043561] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.043561] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.043893] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.065322] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.065505] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.065699] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.065898] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.066261] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-ba6efa62-def3-4765-9824-bba4ebbfa26a taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.066826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.066826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.067267] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.067445] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6efa62-def3-4765-9824-bba4ebbfa26a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.098168] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.098345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.098345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.098883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.098883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.098883] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.099154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.099154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.099336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.099456] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.099456] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be deleted. [ 1062.140666] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.140666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.141025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.141025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.141025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.141188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.570040] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.570537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.570537] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.570822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.571011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.571196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port ba6efa62-def3-4765-9824-bba4ebbfa26a not found, creating... [ 1062.571590] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.571794] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.571922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.572187] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.572322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.572674] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.572838] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.572953] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.573625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.573795] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.573985] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: ba6efa62-def3-4765-9824-bba4ebbfa26a is going to be created. [ 1062.595659] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.595882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.596014] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.596417] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.596652] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.596944] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.347047] env[65080]: INFO networking_nsxv3.common.synchronization [req-5dcf19f8-6976-4672-8af7-43aaa12fbf06 req-8adb32b0-2775-45ea-baa9-19759f37e532 service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1063.347047] env[65080]: INFO networking_nsxv3.common.synchronization [req-5dcf19f8-6976-4672-8af7-43aaa12fbf06 req-8adb32b0-2775-45ea-baa9-19759f37e532 service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1063.347047] env[65080]: INFO networking_nsxv3.common.synchronization [req-5dcf19f8-6976-4672-8af7-43aaa12fbf06 req-8adb32b0-2775-45ea-baa9-19759f37e532 service nova] Enqueued Resource ID: ba6efa62-def3-4765-9824-bba4ebbfa26a with Priority: HIGHEST for action port [ 1063.347047] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1063.350236] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1063.351342] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6efa62-def3-4765-9824-bba4ebbfa26a with Priority: HIGHEST for action port [ 1063.351342] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.351342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.351342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.351342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.351342] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.359109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.359109] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.359109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.359109] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.359573] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba6efa62-def3-4765-9824-bba4ebbfa26a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.359573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.359573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.359573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.359760] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6efa62-def3-4765-9824-bba4ebbfa26a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.861302] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.864138] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.864513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.864593] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba6efa62-def3-4765-9824-bba4ebbfa26a with status ACTIVE [ 1063.864787] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.864911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.865046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.870142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.870142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.870640] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.870640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.870640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.870863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.870863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.871191] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.874057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.874057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.874057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.874057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.874057] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba6efa62-def3-4765-9824-bba4ebbfa26a is going to be updated. [ 1063.907228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.907433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.907433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.907811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.907964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.908121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba6efa62-def3-4765-9824-bba4ebbfa26a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.364500] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.867881] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.868080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.868142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.868343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.868431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.868530] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be created. [ 1064.895465] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.895465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.895465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.895465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.895465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.906028] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: UNINITIALIZED for 2s [ 1065.744695] env[65080]: INFO networking_nsxv3.common.synchronization [req-8b4e7ef6-4fe8-4277-9882-9cb32b9ba9e1 req-004be173-2178-40dd-91b4-f359122e07ef tempest-FloatingIPsAssociationTestJSON-1173945705 tempest-FloatingIPsAssociationTestJSON-1173945705-project-member] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1065.744695] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1065.744695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.744695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.746349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.746349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.748580] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.748580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.748580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.748580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.748580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.748580] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.767022] env[65080]: INFO networking_nsxv3.common.synchronization [req-002638e2-353b-490b-af3e-a89382e2d64b req-8d7a399f-9ed6-4949-8ede-120af77d16f1 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1065.767824] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1065.768155] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.768273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.768338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.768541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.769026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.769026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.769026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.769026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.769363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.769363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.253957] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.273375] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.756223] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.775227] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.918840] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1066.919078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.919788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.919788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.919788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.919788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.920095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.920095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.920095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.920546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.920546] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.154988] env[65080]: INFO networking_nsxv3.common.synchronization [req-491b6a67-a42c-41c7-aa70-6111878716e1 req-ccb2079a-5f78-4dfc-8368-b279a91fef90 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1067.155571] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1067.155881] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.156038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.156150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.156375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.156566] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.156673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.156746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.156891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.156998] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.157128] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.258839] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.259095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.259234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.259474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.259625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.259770] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1067.277387] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.277632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.277684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.277893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.278098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.278162] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1067.294259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.294618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.294618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.294869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.294869] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.305742] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1067.316313] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.316628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.316752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.317121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.317323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.328843] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1067.423798] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.423798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.423798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.423798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.423798] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.423798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.423798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.424328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.424328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.424328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.424615] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.424739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.424886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.424961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.425094] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.425185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.425273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.425414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.425516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.425621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.425711] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.572807] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.573187] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.573287] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.573546] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.573888] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.574167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.574225] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.574540] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.574801] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.574939] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.575063] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.575209] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.575358] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.575499] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.575626] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.575786] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.599445] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.599607] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.599749] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.600095] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.600472] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-56d24bcb-7694-4ed5-b8a7-10bffedf7951 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.600662] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.600793] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.601160] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.601776] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56d24bcb-7694-4ed5-b8a7-10bffedf7951',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.658971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.659223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.659756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.659756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.659756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.660104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.660220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.660319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.660546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.660667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.660789] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 already deleted. [ 1067.660878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.931858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f218e741-66ae-4212-b505-022023a657a5: rpc.has_security_group_logging(os_id): False [ 1067.950146] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.950337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.950396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.950652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.950778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.950987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.951162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.951253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.951426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.951522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.951774] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.951942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.952181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.952457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.952663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.952852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.953030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.953123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.953282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.953374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.953486] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be created. [ 1068.024435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.024613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.024798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.025121] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.025354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.037495] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1068.103963] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.104331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.104520] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.104828] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.104997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.105175] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 56d24bcb-7694-4ed5-b8a7-10bffedf7951 not found, creating... [ 1068.105493] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.105645] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.105816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.106127] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.106248] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.106600] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.106779] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.106896] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.107151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.107293] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.107470] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 56d24bcb-7694-4ed5-b8a7-10bffedf7951 is going to be created. [ 1068.158756] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.159167] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.159310] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.159663] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.159929] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.163059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.850668] env[65080]: INFO networking_nsxv3.common.synchronization [req-491b6a67-a42c-41c7-aa70-6111878716e1 req-ceddccc2-f660-479e-9e38-1861fd96a20c service nova] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1068.850869] env[65080]: INFO networking_nsxv3.common.synchronization [req-491b6a67-a42c-41c7-aa70-6111878716e1 req-ceddccc2-f660-479e-9e38-1861fd96a20c service nova] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1068.851050] env[65080]: INFO networking_nsxv3.common.synchronization [req-491b6a67-a42c-41c7-aa70-6111878716e1 req-ceddccc2-f660-479e-9e38-1861fd96a20c service nova] Enqueued Resource ID: 56d24bcb-7694-4ed5-b8a7-10bffedf7951 with Priority: HIGHEST for action port [ 1068.851651] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1068.851830] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1068.851949] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56d24bcb-7694-4ed5-b8a7-10bffedf7951 with Priority: HIGHEST for action port [ 1068.852315] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.852472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.852541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.852778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.852859] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.854023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.854713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.855070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.855589] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.855806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.855965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.856095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.856278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.856404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.856863] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.857588] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-56d24bcb-7694-4ed5-b8a7-10bffedf7951 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.857726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.857796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.858810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.858810] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56d24bcb-7694-4ed5-b8a7-10bffedf7951',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.327995] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1069.328425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.337255] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1069.337457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.359987] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.361207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.361337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.362074] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56d24bcb-7694-4ed5-b8a7-10bffedf7951 with status ACTIVE [ 1069.362301] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.362418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.362485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.362691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.362818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.363141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.363205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.363360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.363438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.363618] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.363711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.363817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.363905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.363978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.364081] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56d24bcb-7694-4ed5-b8a7-10bffedf7951 is going to be updated. [ 1069.385969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.386167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.386233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.386533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.386724] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.386908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56d24bcb-7694-4ed5-b8a7-10bffedf7951" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.862732] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.050397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1070.050708] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.365747] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.366141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.366201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.366529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.366655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.366754] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be created. [ 1070.394073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.394307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.394307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.394590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.394734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.404588] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: UNINITIALIZED for 2s [ 1072.374169] env[65080]: INFO networking_nsxv3.common.synchronization [req-b5473bbb-f666-410a-ae9a-fabdb283a04a req-f584a7a4-bd87-4c4b-a0ae-c3512225df41 tempest-FloatingIPsAssociationTestJSON-1173945705 tempest-FloatingIPsAssociationTestJSON-1173945705-project-member] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1072.374638] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGHEST for action security_group_members [ 1072.374988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.375306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.375380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.375587] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376096] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.376096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.376096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.376096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.376265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376265] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.415719] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1072.415906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.416082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.416294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.416485] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.416646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.416703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.416884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.416963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.417061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.417154] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.879232] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.879520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.879656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.879973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.880138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.880457] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.880647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.880760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.881048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.881189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.881359] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be updated. [ 1072.914948] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.915190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.915190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.915400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.915555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.919381] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.933558] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: IN_PROGRESS for 2s [ 1073.422849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629476b-3a70-4bd5-b609-8de4bbdf5113: rpc.has_security_group_logging(os_id): False [ 1073.451938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.452140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.452279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.452534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.452631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.452917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.453095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.453184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.453433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.453525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.453598] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be created. [ 1073.530464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.530649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.530736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.530904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.531139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.542229] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1074.945070] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 in Status: SUCCESS [ 1074.945506] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 deletion is rescheduled due to dependency. [ 1074.945506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.029566] env[65080]: INFO networking_nsxv3.common.synchronization [None req-55b59dd8-327a-417d-97c3-95cf19c52435 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: 2277b952-19f4-42b5-b537-2986cda5d0db with Priority: HIGHEST for action security_group_rules [ 1075.030138] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2277b952-19f4-42b5-b537-2986cda5d0db with Priority: HIGHEST for action security_group_rules [ 1075.030439] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2277b952-19f4-42b5-b537-2986cda5d0db taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.030564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.030628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.030877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.030961] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2277b952-19f4-42b5-b537-2986cda5d0db',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.116340] env[65080]: INFO networking_nsxv3.common.synchronization [None req-81c1f8a7-ee23-47e1-b9b3-98629368f8a1 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: 2277b952-19f4-42b5-b537-2986cda5d0db with Priority: HIGHEST for action security_group_rules [ 1075.117247] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2277b952-19f4-42b5-b537-2986cda5d0db with Priority: HIGHEST for action security_group_rules [ 1075.117247] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2277b952-19f4-42b5-b537-2986cda5d0db taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.117508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.554736] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1075.554965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.555939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.556083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.556150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.556354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.556463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.556542] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2277b952-19f4-42b5-b537-2986cda5d0db already deleted. [ 1075.556654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.556790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.556951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.557134] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2277b952-19f4-42b5-b537-2986cda5d0db',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.086858] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.086858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.086858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.086858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.086858] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.086858] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2277b952-19f4-42b5-b537-2986cda5d0db already deleted. [ 1076.087387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2277b952-19f4-42b5-b537-2986cda5d0db" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.077073] env[65080]: INFO networking_nsxv3.common.synchronization [req-f0368721-e4d8-40d6-988d-5a85e0ea98fa req-b590d022-b022-43b0-945b-4adea1ab47f3 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1077.077731] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1077.078141] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.078298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.078388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.078638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.078855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.078990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.079090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.079291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.079404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.079629] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.410528] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.410892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.410892] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.411128] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.411399] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.411606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.411728] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.412022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.412183] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.412392] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.412502] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.412608] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.412712] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.412817] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.412922] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.413062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.446248] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.446546] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.446838] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.447124] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.447615] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.447904] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.448680] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.448680] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.448855] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013ef083-ce39-4e61-9dec-6d3ced0ef2f3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.582590] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.951279] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.951516] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.951569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.951844] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.951992] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.952168] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 not found, creating... [ 1077.952421] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.952576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.952688] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.952902] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.953046] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.953320] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.953471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.953582] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.953781] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.953910] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.954056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 is going to be created. [ 1077.974377] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.974631] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.974733] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.975033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.975281] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.975523] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084707] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.588205] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.588866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.588866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.589105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.589105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.589289] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1078.624566] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.624847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.624932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.625202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.625365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.633516] env[65080]: INFO networking_nsxv3.common.synchronization [req-9fc30c5d-7158-49d3-a1a7-41193aa23b10 req-6991ad34-414c-475d-8069-4aa87e2708ff tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1078.634254] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1078.635209] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1078.635476] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.635602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.635670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.635870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.636037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.636143] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.636208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.636384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.636487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.636586] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.698820] env[65080]: INFO networking_nsxv3.common.synchronization [req-f0368721-e4d8-40d6-988d-5a85e0ea98fa req-e201b8c8-96ad-4868-bca5-63c3d1dd0566 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1078.699071] env[65080]: INFO networking_nsxv3.common.synchronization [req-f0368721-e4d8-40d6-988d-5a85e0ea98fa req-e201b8c8-96ad-4868-bca5-63c3d1dd0566 service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1078.699222] env[65080]: INFO networking_nsxv3.common.synchronization [req-f0368721-e4d8-40d6-988d-5a85e0ea98fa req-e201b8c8-96ad-4868-bca5-63c3d1dd0566 service nova] Enqueued Resource ID: 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 with Priority: HIGHEST for action port [ 1078.699704] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1078.699843] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1078.699939] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 with Priority: HIGHEST for action port [ 1078.700228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.700378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.700555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.700654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.700687] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.701775] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.701876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.702093] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.702229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.702272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.702396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.702473] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013ef083-ce39-4e61-9dec-6d3ced0ef2f3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.139721] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.139987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.140169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.140282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.161071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.161337] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.161455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.161544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.161807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.161896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.161990] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1079.189241] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.189651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.189727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.189958] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.190097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.199520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1079.204950] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 with status ACTIVE [ 1079.205193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.205333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.205398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.205604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.205694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.205875] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.205975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.206063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.206272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.206357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.206594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.206720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.206788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.206935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.207022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.207117] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013ef083-ce39-4e61-9dec-6d3ced0ef2f3 is going to be updated. [ 1079.208615] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.208854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.253571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.253786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.253786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.253994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.254147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.254312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013ef083-ce39-4e61-9dec-6d3ced0ef2f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.646568] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1080.646940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.647020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.647245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.647434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.647552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.647627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.647785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.647870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.647967] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.150662] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.208671] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1081.209643] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1081.209930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.653267] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.155868] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.156065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.156155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.156377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.157901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.157901] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1082.187638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.187797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.187864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.188073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.188218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.211221] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1083.166324] env[65080]: INFO networking_nsxv3.common.synchronization [req-6ba10ffd-c5ed-4827-8fbf-85315aafb471 req-9b9b7e03-3895-48be-bbf4-8c30b6295b59 tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1083.167035] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1083.167307] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.167433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.167499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.167823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.167947] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.169403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.169403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.169658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.169772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.169933] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.672398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.672600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.672600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.672768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.672862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.673144] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.673266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.673266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.673373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.673446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.673533] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1083.690613] env[65080]: INFO networking_nsxv3.common.synchronization [None req-5cad3715-5b34-449a-922b-cfb82e2be79d None None] Enqueued Resource ID: 342e8096-602c-417f-b9ff-ee31d2584231 with Priority: HIGHEST for action port [ 1083.691232] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342e8096-602c-417f-b9ff-ee31d2584231 with Priority: HIGHEST for action port [ 1083.691606] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-342e8096-602c-417f-b9ff-ee31d2584231 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.691747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-342e8096-602c-417f-b9ff-ee31d2584231" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.691863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-342e8096-602c-417f-b9ff-ee31d2584231" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.692261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-342e8096-602c-417f-b9ff-ee31d2584231" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.692261] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('342e8096-602c-417f-b9ff-ee31d2584231',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.704766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.704979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.704979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.705191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.705336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.717447] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1084.194429] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 342e8096-602c-417f-b9ff-ee31d2584231 [ 1084.196025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.196025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.196025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.196025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.196025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.196025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:342e8096-602c-417f-b9ff-ee31d2584231 already deleted. [ 1084.196025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-342e8096-602c-417f-b9ff-ee31d2584231" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.223290] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1084.223646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.224077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.224496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.224496] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.224620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.224620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.224810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.226032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.226660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.226854] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.302078] env[65080]: INFO networking_nsxv3.common.synchronization [req-f98c102c-89d2-449a-a8fc-e2b3d1e3a3b9 req-2829da6c-0ddd-4fd6-9a1b-ac1a924a33a2 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1084.302661] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1084.302974] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.303108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.303191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.303407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.303627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.303681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.303732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.303900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.303994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.304125] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.702768] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.702981] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.703129] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.703401] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.703670] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.703891] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.703946] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.704164] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.704381] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.704614] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.704878] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.704982] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.705107] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.705372] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.705372] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.705459] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.731124] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.731124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.731124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.731124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.731353] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.731353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.731443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.731539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.731625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.731727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.731858] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.731951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.732021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.732168] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.732305] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.732398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.732459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.732593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.732670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.732753] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.732848] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.799659] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.799923] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.094 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.800086] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.800265] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.800711] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-9d33e533-64eb-4032-b2de-291a58bebaec taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.800909] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.801079] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.801436] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.801574] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d33e533-64eb-4032-b2de-291a58bebaec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.806397] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.806523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.806586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.806850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.806934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.807142] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.807243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.807306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.807453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.807530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.807612] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1084.838290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.838463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.838512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.838695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.838833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.848145] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1085.236232] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 1085.254857] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.255113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.255176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.255396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.256108] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.256365] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.256478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.256546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.256736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.256837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.257052] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.257153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.257216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.257364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.257442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.257669] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.257781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.257847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.257990] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.258152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.258240] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1085.305600] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.305836] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.305963] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.306279] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.306426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.306580] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 9d33e533-64eb-4032-b2de-291a58bebaec not found, creating... [ 1085.306909] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.307083] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.307196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.307413] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.307546] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.307917] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.308258] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.308416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.308677] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.308852] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.309063] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 9d33e533-64eb-4032-b2de-291a58bebaec is going to be created. [ 1085.358797] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.358797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.358797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.358797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.358797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.362066] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.362303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.362444] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.362700] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.362933] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.363172] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.390382] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1085.732766] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1085.732766] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 deletion is rescheduled due to dependency. [ 1085.732766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.778429] env[65080]: INFO networking_nsxv3.common.synchronization [None req-71865c88-8946-45de-9b37-ae681d572a75 None None] Enqueued Resource ID: 0324c28b-b778-478f-828f-df311f08879d with Priority: HIGHEST for action port [ 1085.779020] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0324c28b-b778-478f-828f-df311f08879d with Priority: HIGHEST for action port [ 1085.779335] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0324c28b-b778-478f-828f-df311f08879d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.779447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0324c28b-b778-478f-828f-df311f08879d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.779537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0324c28b-b778-478f-828f-df311f08879d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.779767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0324c28b-b778-478f-828f-df311f08879d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.779859] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0324c28b-b778-478f-828f-df311f08879d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.003227] env[65080]: INFO networking_nsxv3.common.synchronization [req-f98c102c-89d2-449a-a8fc-e2b3d1e3a3b9 req-cd894d14-1cda-44d8-a75a-ad98d9858deb service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1086.003227] env[65080]: INFO networking_nsxv3.common.synchronization [req-f98c102c-89d2-449a-a8fc-e2b3d1e3a3b9 req-cd894d14-1cda-44d8-a75a-ad98d9858deb service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1086.003351] env[65080]: INFO networking_nsxv3.common.synchronization [req-f98c102c-89d2-449a-a8fc-e2b3d1e3a3b9 req-cd894d14-1cda-44d8-a75a-ad98d9858deb service nova] Enqueued Resource ID: 9d33e533-64eb-4032-b2de-291a58bebaec with Priority: HIGHEST for action port [ 1086.003857] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1086.004021] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1086.004177] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d33e533-64eb-4032-b2de-291a58bebaec with Priority: HIGHEST for action port [ 1086.004459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.004654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.004825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.004960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.005140] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.005906] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.006041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.006199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d33e533-64eb-4032-b2de-291a58bebaec taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.006322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.006392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.006517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.006588] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d33e533-64eb-4032-b2de-291a58bebaec',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.285091] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0324c28b-b778-478f-828f-df311f08879d [ 1086.285091] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.285091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.285091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.285091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.285091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.285091] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0324c28b-b778-478f-828f-df311f08879d already deleted. [ 1086.285936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0324c28b-b778-478f-828f-df311f08879d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.507930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.508086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.508306] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d33e533-64eb-4032-b2de-291a58bebaec with status ACTIVE [ 1086.509429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.509429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.509429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.509945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.509945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.509945] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.509945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.510106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.510174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.510270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.510380] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d33e533-64eb-4032-b2de-291a58bebaec is going to be updated. [ 1086.532750] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.532906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.532964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.533663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.533810] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.535115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d33e533-64eb-4032-b2de-291a58bebaec" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.753362] env[65080]: INFO networking_nsxv3.common.synchronization [req-65f30575-31ec-44bf-a8bf-93b644da3e3c req-0862a18a-6d88-4f38-b8bd-f92c01ac18d3 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1086.754260] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1086.754603] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.755350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.755350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.755611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.755721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.755762] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.870618] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1086.870831] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1086.871185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.871860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.872228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.872483] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.873084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.873084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.873084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.873084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.873252] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.079626] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.079837] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.079962] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.080246] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.080494] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.080656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.080765] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.080973] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.081136] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.081338] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.081449] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.081557] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.081664] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.081772] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.081885] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.082041] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.104283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.104437] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.104574] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.104785] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.105146] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.105364] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.105496] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.105805] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.105939] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.259175] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.376142] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.405399] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1087.405756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.608568] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.608825] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.608895] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.609216] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.609370] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.609520] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c not found, creating... [ 1087.609780] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.609941] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.610067] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.610291] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.610433] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.610733] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.610884] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.611015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.611267] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.611402] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.611538] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c is going to be created. [ 1087.633160] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.633380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.633501] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.633781] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.634198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.634484] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.760738] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.885375] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.263575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.263796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.263796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.264560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.264779] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.264779] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be updated. [ 1088.300452] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.300674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.300825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.301161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.301337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.313055] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1088.387976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.388328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.388376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.388579] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.388674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.388777] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1088.395155] env[65080]: INFO networking_nsxv3.common.synchronization [req-65f30575-31ec-44bf-a8bf-93b644da3e3c req-1af69937-bda2-480d-93c9-768a8902e0a4 service nova] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1088.395336] env[65080]: INFO networking_nsxv3.common.synchronization [req-65f30575-31ec-44bf-a8bf-93b644da3e3c req-1af69937-bda2-480d-93c9-768a8902e0a4 service nova] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1088.395574] env[65080]: INFO networking_nsxv3.common.synchronization [req-65f30575-31ec-44bf-a8bf-93b644da3e3c req-1af69937-bda2-480d-93c9-768a8902e0a4 service nova] Enqueued Resource ID: df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c with Priority: HIGHEST for action port [ 1088.396106] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_rules [ 1088.396238] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1088.396337] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c with Priority: HIGHEST for action port [ 1088.396621] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.396832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.397033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.397118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.397194] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.398584] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.398785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.399097] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.399204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.399204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.399390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.399477] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.429016] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.429288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.429288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.429491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.429635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.438803] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1088.901104] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.901104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.901371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c with status ACTIVE [ 1088.901950] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.901950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.901950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.902250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.902368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.902594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.902721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.902791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.902983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.903103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.903357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.903475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.903578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.903768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.903849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.903954] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c is going to be updated. [ 1088.945345] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.945573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.945646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.945981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.946315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.947161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df9e7bdb-7698-4e8d-8b44-3bf73a4ac76c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.282063] env[65080]: INFO networking_nsxv3.common.synchronization [req-10580192-3e8d-4b5a-938b-aa565c16d92d req-e4aec0ef-fc94-4a84-8caa-1b2a241e3a58 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1090.282542] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1090.283546] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.283546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.283546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.283546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.283794] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.283794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.283794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.284532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.284532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.284532] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.324559] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1090.325220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.325220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.325367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.325442] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.325563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.325631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.326471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.326471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.326471] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.447748] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1090.448040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.448233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.448493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.448698] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.448817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.449348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.449557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.449653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.449747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.449843] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.786883] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.830400] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.857219] env[65080]: INFO networking_nsxv3.common.synchronization [req-88cd9238-bd2c-4d65-aea2-29a39204dd05 req-d5da9947-ee2c-433f-be49-6eed293ac4ae tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1090.857716] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1090.858120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.858247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.858316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.858564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.858708] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.858808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.858868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.859018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.859250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.859375] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.951748] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.951888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.952055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.952695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.952695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.952695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.952840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.953018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.953018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.953117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.953257] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.953374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.953435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.953574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.953755] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.953817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.953848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.954486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.954486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.954486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.954486] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.136955] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.137271] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.137403] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.137712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.137978] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.138313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.138437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.138658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.138804] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.139028] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.139144] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.139248] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.139353] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.139462] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.139563] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.139692] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.159630] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.159812] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.159924] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.160130] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.160439] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-1f7aa93f-392a-4100-98be-0896aff45479 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.160614] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.160720] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.161071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.161217] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7aa93f-392a-4100-98be-0896aff45479',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.289898] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.332410] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.362259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.362446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.362548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.362766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.362862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.363077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.363177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.363241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.363390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.363479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.363565] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 already deleted. [ 1091.363646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.456878] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d: rpc.has_security_group_logging(os_id): False [ 1091.475391] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.475578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.475633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.475820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.475942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.476178] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.476275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.476343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.476514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.476594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.476842] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.476955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.477029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.477174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.477251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.477448] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.477553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.477620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.477761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.477841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.477928] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1091.537852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.537852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.537852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.537852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.537852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.549962] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1091.664027] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.664317] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.664464] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.664841] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.664952] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.665120] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 1f7aa93f-392a-4100-98be-0896aff45479 not found, creating... [ 1091.665436] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.665603] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.665724] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.665981] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.666145] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.666444] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.666605] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.666719] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.666994] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.667170] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.667342] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 1f7aa93f-392a-4100-98be-0896aff45479 is going to be created. [ 1091.688094] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.688335] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.688467] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.688723] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.688960] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.689269] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.793514] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.794890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.795009] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.795331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.795443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.795550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1091.835601] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.835759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.835836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.836961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.836961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.836961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be updated. [ 1091.869254] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.869422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.870016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.870016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.870016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.879208] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1091.905095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.905095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.905095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.905095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.905323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.920101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1092.413410] env[65080]: INFO networking_nsxv3.common.synchronization [req-88cd9238-bd2c-4d65-aea2-29a39204dd05 req-1f047b37-9bc2-4127-b866-4a4f8f7b1705 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1092.413690] env[65080]: INFO networking_nsxv3.common.synchronization [req-88cd9238-bd2c-4d65-aea2-29a39204dd05 req-1f047b37-9bc2-4127-b866-4a4f8f7b1705 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1092.413739] env[65080]: INFO networking_nsxv3.common.synchronization [req-88cd9238-bd2c-4d65-aea2-29a39204dd05 req-1f047b37-9bc2-4127-b866-4a4f8f7b1705 service nova] Enqueued Resource ID: 1f7aa93f-392a-4100-98be-0896aff45479 with Priority: HIGHEST for action port [ 1092.416127] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1092.416127] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1092.416127] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7aa93f-392a-4100-98be-0896aff45479 with Priority: HIGHEST for action port [ 1092.416127] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.416127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.416127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.416411] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.416411] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.417516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.417634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.417801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.418069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.418226] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.418326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.418389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.418532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.418618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.418716] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.419463] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f7aa93f-392a-4100-98be-0896aff45479 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.419577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.419651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.419799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.419873] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7aa93f-392a-4100-98be-0896aff45479',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.921506] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.923062] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.923062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.923062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f7aa93f-392a-4100-98be-0896aff45479 with status ACTIVE [ 1092.923245] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.923245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.923337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.923517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.923653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.924822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.924822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.924822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.924822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.924822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.924822] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.925091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.925091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.925248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.925361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.925490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f7aa93f-392a-4100-98be-0896aff45479 is going to be updated. [ 1092.950203] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.950447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.950547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.950863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.951056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.951257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f7aa93f-392a-4100-98be-0896aff45479" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.429054] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.566654] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1093.566964] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.889940] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1093.890610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.902679] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a6a37cf-0062-49c2-ba64-832111e1a069 req-b83c094c-e749-43cb-99fa-401bcfe4c89d tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1093.906035] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1093.906035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.906035] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.906035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.906035] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.933564] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.933752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.933809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.934022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.934165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.934272] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be created. [ 1093.936598] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1093.936783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.937078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.937389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.937638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.937845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.938039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.938205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.938880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.939615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.939615] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.994719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.994915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.995138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.995444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.995619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.006610] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: UNINITIALIZED for 2s [ 1094.220808] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.221042] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.221151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.221444] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.221676] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.221830] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.221947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.222177] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.222314] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.222523] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.222620] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.222728] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.222886] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.223009] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.223119] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.223265] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.246947] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.247273] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.247461] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.247658] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.247994] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-632fccaf-a80b-47e4-ba6a-dcf076613882 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.248215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.248385] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.248792] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.248951] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632fccaf-a80b-47e4-ba6a-dcf076613882',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.410722] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.410906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.410978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.411225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.411332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.411536] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.411644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.411728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.411866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.411944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.412177] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1094.442450] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.442755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.442755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.442918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.443132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.444245] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.456030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1094.753566] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.753566] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 632fccaf-a80b-47e4-ba6a-dcf076613882 not found, creating... [ 1094.753566] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.753566] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.753994] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753994] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753994] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.754149] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.754149] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.754508] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 632fccaf-a80b-47e4-ba6a-dcf076613882 is going to be created. [ 1094.775772] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.776092] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.776092] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.776383] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.776647] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.776930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.946794] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629476b-3a70-4bd5-b609-8de4bbdf5113: rpc.has_security_group_logging(os_id): False [ 1094.967039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.967205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.967288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.967522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.967623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.967920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.968205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.968205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.968357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.968397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.968511] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be updated. [ 1095.040590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.040819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.040885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.041372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.041372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.058132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1095.434248] env[65080]: INFO networking_nsxv3.common.synchronization [req-2ef2232b-56b1-4b57-8b0b-56401b539737 req-631557b4-987e-46b4-91d2-b8e3ba56e146 tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1095.434248] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1095.434561] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.434703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.434754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.435015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.435190] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.435291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.435357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.435507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.435596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.435692] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.519496] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a6a37cf-0062-49c2-ba64-832111e1a069 req-2d38e896-e4a6-4069-9777-ab61a530f2ac service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1095.519810] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a6a37cf-0062-49c2-ba64-832111e1a069 req-2d38e896-e4a6-4069-9777-ab61a530f2ac service nova] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1095.519949] env[65080]: INFO networking_nsxv3.common.synchronization [req-6a6a37cf-0062-49c2-ba64-832111e1a069 req-2d38e896-e4a6-4069-9777-ab61a530f2ac service nova] Enqueued Resource ID: 632fccaf-a80b-47e4-ba6a-dcf076613882 with Priority: HIGHEST for action port [ 1095.520467] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_rules [ 1095.520632] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1095.520810] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632fccaf-a80b-47e4-ba6a-dcf076613882 with Priority: HIGHEST for action port [ 1095.521706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.521706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.521706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.521706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.521706] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.523368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.523368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.523368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-632fccaf-a80b-47e4-ba6a-dcf076613882 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.523368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.523368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.523368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.523603] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632fccaf-a80b-47e4-ba6a-dcf076613882',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.938630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.938828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.939066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.939394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.965678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.965949] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.966120] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.966224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.966441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.966616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.966724] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1096.003429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.003644] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.003735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.004066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.004267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.014760] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1096.015688] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1096.015925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.016179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.016410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.016654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.016778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.016875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.017073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.017187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.017281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.017387] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.025439] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.025612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.027060] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 632fccaf-a80b-47e4-ba6a-dcf076613882 with status ACTIVE [ 1096.027283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.027497] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.027611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.027828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.027936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.028251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.028414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.028442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.028616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.028710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.028931] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.029358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.029358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.029358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.029481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.029481] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 632fccaf-a80b-47e4-ba6a-dcf076613882 is going to be updated. [ 1096.051656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.051656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.051656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.051854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.052206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.052206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632fccaf-a80b-47e4-ba6a-dcf076613882" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.466198] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1096.466423] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 deletion is rescheduled due to dependency. [ 1096.466565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.467334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.467552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.467771] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.467920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.468048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.468351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.468494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.468661] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.520039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.520475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.520475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.520475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.520619] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.520698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.520763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.520909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.520996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.521101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.521300] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.521415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.521415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.521637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.522073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.522073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.522253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.522379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.522508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.522643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.522789] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.971839] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.025272] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1097.043458] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.043717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.043841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.044196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.044347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.044690] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.044820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.044957] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.045256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.045408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.045741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.045946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.046218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.046413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.046499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.046709] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.046809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.046924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.047097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.047176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.047271] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be created. [ 1097.069850] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1097.070109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.113951] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.114128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.114162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.114550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.114550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.128925] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1097.474102] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.976918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.977443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.977443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.977552] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.977622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.977856] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1098.029887] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1098.030860] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf deletion is rescheduled due to dependency. [ 1098.031060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.044524] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.044752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.044845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.045158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.045373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.060614] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1099.143292] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1099.143623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.531439] env[65080]: INFO networking_nsxv3.common.synchronization [None req-7ab3a67a-0d1b-4ae5-bcc6-05b6756552f9 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1099.531941] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1099.532317] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.532445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.532513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.532775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.532925] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.533037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.533099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.533256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.533343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.533437] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.035153] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.035408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.035408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.035714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.035818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.035954] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.036583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.036583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.036583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.036583] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.036583] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1100.067677] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.067879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.067934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.068263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.068452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.072811] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1100.073089] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.073288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.073541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.073779] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.073901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.073972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.074180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.074270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.074451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.074569] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.076403] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1100.580901] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.581434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.581434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.581570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.581887] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.582032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.582141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.582348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.582466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.582586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.582772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.582903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.582970] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.583263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.583452] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.583580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.583665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.583842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.583951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.584076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.584202] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.086755] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f218e741-66ae-4212-b505-022023a657a5: rpc.has_security_group_logging(os_id): False [ 1101.105479] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.105653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.105734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.105889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.105979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.106212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.106383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.106464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.106626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.106702] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.106884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.107051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.107116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.107282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.107374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.107594] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.107693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.107755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.107901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.108016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.108121] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1101.168606] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.168764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.168854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.169047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.169195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.184081] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1101.988187] env[65080]: INFO networking_nsxv3.common.synchronization [req-5df6fb0b-0e85-4201-9544-e4bb3fa5fa37 req-16f03769-febe-4b1c-bf30-8f6a24f234c6 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1101.988187] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1101.988187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.988187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.988187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.988187] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.088464] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1102.088464] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 deletion is rescheduled due to dependency. [ 1102.088464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.322273] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.322741] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.322941] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.323557] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.323896] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.324297] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.324394] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.324742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.324989] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.325344] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.325530] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.325708] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.325885] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.326092] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.326273] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.326483] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.349283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.349446] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.349594] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.349778] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-915" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.350113] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-6eb7acd2-394c-4788-ab85-35ba5a6a2128 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.350276] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.350400] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.350742] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.350879] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb7acd2-394c-4788-ab85-35ba5a6a2128',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.490688] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.853926] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.854202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.854329] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.854661] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.854894] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.855110] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 6eb7acd2-394c-4788-ab85-35ba5a6a2128 not found, creating... [ 1102.855396] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.855588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.855707] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.855973] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.856180] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.856581] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.856824] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.856990] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.857254] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.857425] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.857586] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 6eb7acd2-394c-4788-ab85-35ba5a6a2128 is going to be created. [ 1102.879690] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.879924] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.880171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.880535] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.880775] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.881013] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.992112] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.199283] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1103.199541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.494978] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.495268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.495342] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.495865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.495865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.495865] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1103.522761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.522955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.523056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.523291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.523468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.534415] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1103.608425] env[65080]: INFO networking_nsxv3.common.synchronization [req-5df6fb0b-0e85-4201-9544-e4bb3fa5fa37 req-a090f13b-bf50-48bf-9626-95253f2857df service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1103.608517] env[65080]: INFO networking_nsxv3.common.synchronization [req-5df6fb0b-0e85-4201-9544-e4bb3fa5fa37 req-a090f13b-bf50-48bf-9626-95253f2857df service nova] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1103.608697] env[65080]: INFO networking_nsxv3.common.synchronization [req-5df6fb0b-0e85-4201-9544-e4bb3fa5fa37 req-a090f13b-bf50-48bf-9626-95253f2857df service nova] Enqueued Resource ID: 6eb7acd2-394c-4788-ab85-35ba5a6a2128 with Priority: HIGHEST for action port [ 1103.609287] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_rules [ 1103.609436] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1103.609520] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb7acd2-394c-4788-ab85-35ba5a6a2128 with Priority: HIGHEST for action port [ 1103.610368] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.610476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.611545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.611545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.611545] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.611922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.612094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.612286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb7acd2-394c-4788-ab85-35ba5a6a2128 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.612399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.612799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.612799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.612799] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb7acd2-394c-4788-ab85-35ba5a6a2128',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.115229] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.115546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.115584] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb7acd2-394c-4788-ab85-35ba5a6a2128 with status ACTIVE [ 1104.115732] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.115839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.115904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.116269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.116269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.116396] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.116561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.116635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.116793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.116872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.117165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.117285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.117353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.117498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.117577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.117750] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb7acd2-394c-4788-ab85-35ba5a6a2128 is going to be updated. [ 1104.145490] env[65080]: INFO networking_nsxv3.common.synchronization [req-5e2584af-80dd-4dbd-bb52-65744f60ad72 req-4473bb12-95ac-41a8-8678-04cf26bd275f tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1104.146132] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1104.147208] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.147339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.147408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.147609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.147748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.147899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb7acd2-394c-4788-ab85-35ba5a6a2128" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.148233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.148377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.148480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.148696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.149089] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.149197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.149308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.149520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.149650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.149803] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.531033] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.531331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.531527] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.531880] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.532582] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.532824] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.532998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.533328] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.533633] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.533950] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.534129] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.534292] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.534451] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.534753] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.534957] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.535180] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.556888] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.556888] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.556888] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.556888] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.556888] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-b0f33b73-120f-4ea5-bc9b-184f2034f265 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.557230] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.557230] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.557498] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.557643] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f33b73-120f-4ea5-bc9b-184f2034f265',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.652988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.653221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.653221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.653422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.653516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.653801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.653908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.653973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.654152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.654232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.654320] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1104.682097] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.682334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.682459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.682784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.683014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.692886] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1104.999824] env[65080]: INFO networking_nsxv3.common.synchronization [req-191271a2-7e0f-4209-8e2d-f3211d5a41bc req-000afd75-c59b-40b2-9f9d-c09cf2f99b49 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1105.000389] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1105.000696] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.001226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.001305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.001736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.001903] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.002018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.002085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.002236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.002323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.002415] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.060061] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.060448] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.060582] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.060863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.061020] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.061201] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port b0f33b73-120f-4ea5-bc9b-184f2034f265 not found, creating... [ 1105.061496] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.061664] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.061782] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.062009] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.062166] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.062453] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.062609] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.062727] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.062932] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.063189] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.063348] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 is going to be created. [ 1105.086867] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.087154] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.087286] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.087556] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.087776] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.088009] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.508142] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.508142] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.508142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.508142] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1105.538080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.538080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.538080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.538080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.538080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.548854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1105.549393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.549756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.550101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.551621] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.551621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.551621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.551621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.551621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.551621] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.552892] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [req-5e2584af-80dd-4dbd-bb52-65744f60ad72 req-b06306cf-d7e2-4a5a-b3fb-8ec0f68995eb service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [req-5e2584af-80dd-4dbd-bb52-65744f60ad72 req-b06306cf-d7e2-4a5a-b3fb-8ec0f68995eb service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [req-5e2584af-80dd-4dbd-bb52-65744f60ad72 req-b06306cf-d7e2-4a5a-b3fb-8ec0f68995eb service nova] Enqueued Resource ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 with Priority: HIGHEST for action port [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1105.850046] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 with Priority: HIGHEST for action port [ 1105.850922] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.851221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.851398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.851727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.851908] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.853027] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.853767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.854170] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0f33b73-120f-4ea5-bc9b-184f2034f265 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.854894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.855073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.855379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.855774] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f33b73-120f-4ea5-bc9b-184f2034f265',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.053841] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.362025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.362025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0f33b73-120f-4ea5-bc9b-184f2034f265 with status ACTIVE [ 1106.362025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.362025] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.362025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.362525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.362525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.362867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.362867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.363045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.363266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.363422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.363572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 is going to be updated. [ 1106.387071] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.387237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.387353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.387576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.387745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.387914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.507823] env[65080]: INFO networking_nsxv3.common.synchronization [req-49a3e893-4426-4ed5-8ed3-8a563a938566 req-5b6164cd-d618-4f42-93c6-f3ccb77af49f tempest-ImagesOneServerNegativeTestJSON-757151018 tempest-ImagesOneServerNegativeTestJSON-757151018-project-member] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1106.508393] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGHEST for action security_group_members [ 1106.508709] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.508823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.508920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.509231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.509417] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.509417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.509495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.509593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.509667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.509753] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.556042] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.704132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1106.704343] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf deletion is rescheduled due to dependency. [ 1106.704460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.704620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.704832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.705086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.705178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.705247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.705403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.705507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.705578] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.014646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.014646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.014646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.014646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.014646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.014646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.015024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.015024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.015085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.015131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.015230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be updated. [ 1107.049953] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.049953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.049953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.049953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.049953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.060437] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: IN_PROGRESS for 2s [ 1107.060805] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.060938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.061046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.061226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.061322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.061421] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1107.092950] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.093963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.093963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.093963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.093963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.102767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1107.207548] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.563678] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1107.564066] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1107.564066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.709797] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.214992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.215629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.215629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.215629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.215629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.215876] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1108.252154] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.252408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.252408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.252640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.252796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.266516] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1109.071867] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f218e741-66ae-4212-b505-022023a657a5 in Status: SUCCESS [ 1109.071867] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f218e741-66ae-4212-b505-022023a657a5 deletion is rescheduled due to dependency. [ 1109.071867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.111838] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1109.112119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.112417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.112655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.113407] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.113407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.113407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.113407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.113407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.113407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.113407] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.615563] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.615791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.615834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.616154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.616385] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.616510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.616580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.616767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.616853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.616960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.617173] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.617285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.617346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.617499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.617646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.617817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.617817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.617947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.618101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.618258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.618405] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.121352] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63c7032c-d9d0-44bc-a95a-298729548f78: rpc.has_security_group_logging(os_id): False [ 1110.141095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.141621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.141621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.141621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.141621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.141885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.141981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.141981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.142177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.142253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.142440] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.142600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.142600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.142795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.142860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.143120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.143197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.143247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.143377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.143840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.143840] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1110.213384] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.213384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.213384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.213636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.213703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.231060] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1110.278844] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1110.278844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.278844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.278844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.278844] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.279352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.279352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.279352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.279352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.279352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.279490] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.781785] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.284471] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65229547-ee66-4305-8bfe-45dde2354faf: rpc.has_security_group_logging(os_id): False [ 1111.303731] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.303878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.303951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.304253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.304374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.304623] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.304725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.304789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.304942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.305051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.305142] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1111.374303] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.374303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.374303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.374514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.374691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.386907] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1111.509631] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1111.509764] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1112.245846] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1112.246137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.406389] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1113.406847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.937055] env[65080]: INFO networking_nsxv3.common.synchronization [req-15868ee5-b305-41e3-a3b1-54fdb8edbf4a req-a1085c03-f1f2-4c80-8d61-6490e316167a tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 1113.939402] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGHEST for action security_group_members [ 1113.939402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.939402] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.939402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.939732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.939732] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.443495] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.443495] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.443495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.444162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.444162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.444162] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ac16de-c17b-4005-aa11-407133216460 is going to be updated. [ 1114.476963] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.477202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.477202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.477404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.477553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.486652] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: IN_PROGRESS for 2s [ 1114.761622] env[65080]: INFO networking_nsxv3.common.synchronization [req-336c06f1-d4c5-42d7-a2c7-9cf9e5bb7d2e req-8513b932-cd70-46d6-a1ed-8402fda06933 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1114.765023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1114.765023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.765023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.765023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.765023] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.132025] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.132381] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.132605] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.133033] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.133492] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.133768] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.133968] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.134349] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.134622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.135056] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.135239] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.135454] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.135665] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.135885] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.136120] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.136417] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.158573] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.158872] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.159120] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.159383] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.159825] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-8de9d404-fcfa-48a0-9c47-5039c6a99d97 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.160117] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.160330] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.160746] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.160939] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de9d404-fcfa-48a0-9c47-5039c6a99d97',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.267037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.267618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.267618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.267618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.267618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.267804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.267897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.267962] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.268145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.268260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.268381] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1115.299349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.299506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.299506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.300804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.300804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.322476] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1115.664717] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.665141] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.665231] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.665618] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.665819] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.666045] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 8de9d404-fcfa-48a0-9c47-5039c6a99d97 not found, creating... [ 1115.666448] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.666675] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.666845] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.670936] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.671187] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.671851] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.671851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.672008] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.672565] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.672565] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.672677] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 8de9d404-fcfa-48a0-9c47-5039c6a99d97 is going to be created. [ 1115.695905] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.696118] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.696292] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.696655] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.696973] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.697336] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.423582] env[65080]: INFO networking_nsxv3.common.synchronization [req-336c06f1-d4c5-42d7-a2c7-9cf9e5bb7d2e req-3724f4a2-9f2c-42db-8334-79b1f840753a service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1116.424106] env[65080]: INFO networking_nsxv3.common.synchronization [req-336c06f1-d4c5-42d7-a2c7-9cf9e5bb7d2e req-3724f4a2-9f2c-42db-8334-79b1f840753a service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1116.424447] env[65080]: INFO networking_nsxv3.common.synchronization [req-336c06f1-d4c5-42d7-a2c7-9cf9e5bb7d2e req-3724f4a2-9f2c-42db-8334-79b1f840753a service nova] Enqueued Resource ID: 8de9d404-fcfa-48a0-9c47-5039c6a99d97 with Priority: HIGHEST for action port [ 1116.425118] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1116.425327] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1116.425463] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9d404-fcfa-48a0-9c47-5039c6a99d97 with Priority: HIGHEST for action port [ 1116.425801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.426094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.426094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.426344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.426453] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.427554] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.427676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.427913] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-8de9d404-fcfa-48a0-9c47-5039c6a99d97 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.428102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.428202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.428434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.428573] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8de9d404-fcfa-48a0-9c47-5039c6a99d97',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.496500] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66ac16de-c17b-4005-aa11-407133216460 in Status: SUCCESS [ 1116.496688] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66ac16de-c17b-4005-aa11-407133216460 deletion is rescheduled due to dependency. [ 1116.497074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.931097] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8de9d404-fcfa-48a0-9c47-5039c6a99d97 with status ACTIVE [ 1116.931390] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.931534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.931605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.931815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.931901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.932135] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.932216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.932264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.932375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.932451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.932630] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.932722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.932782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.932915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.932989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.933134] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8de9d404-fcfa-48a0-9c47-5039c6a99d97 is going to be updated. [ 1116.934288] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.934387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.955496] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.955675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.955725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.955929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.956077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.956246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8de9d404-fcfa-48a0-9c47-5039c6a99d97" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.334929] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1117.334929] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1117.334929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.334929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.335102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.335575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.335734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.335805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.336113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.336223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.336326] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.426998] env[65080]: INFO networking_nsxv3.common.synchronization [req-1618d01d-61ad-4b58-81a5-57f6ac4475b8 req-ee3c7a6e-0d5c-4ee5-95e0-9cfd9999e6d8 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1117.427595] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1117.427902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.428030] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.428098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.428312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.428452] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.428550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.428613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.428761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.428849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.429160] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.839070] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.931071] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.341564] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.433563] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.844474] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.844635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.844694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.844933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.845076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.845270] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1118.869751] env[65080]: INFO networking_nsxv3.common.synchronization [None req-dde86d5a-8a2d-4cf7-bc5f-d29fa3154b0a tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1118.870871] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1118.871193] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.871317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.871317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.872052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.872052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.876057] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.876279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.876390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.876684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.876915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.887970] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1118.936043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.936283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.936283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.936508] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.936604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.936705] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1118.951207] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b68c141f-d59c-4b6e-81bc-5f6b16af5292 tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1118.951768] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1118.952077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.952184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.975980] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.976186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.976278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.976541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.976698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.987630] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1119.391293] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.391654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.391654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.391717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.391842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.391842] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 already deleted. [ 1119.391981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.392078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.392493] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.392584] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.913149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.913373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.913548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.913786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.914142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.914142] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 already deleted. [ 1119.914260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.909383] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1120.909769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.909823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.910096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.910350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.910474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.910541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.910747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.910825] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.910918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.911018] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.998677] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1120.998677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.413389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.413537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.413608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.413830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.414014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.414130] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.414195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.414352] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.414438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.414526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.414676] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.414767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.414822] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.414963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.415122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.415227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.415286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.415447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.415559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.415650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.415742] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.917901] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1121.937039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.937039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.937039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.937039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.937039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.937357] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.937357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.937357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.937542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.937625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.937996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.937996] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.938131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.938263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.938364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.938561] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.938658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.938719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.938859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.938935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.939033] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1122.041405] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.041608] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.041685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.041928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.042093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.056686] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1123.703159] env[65080]: INFO networking_nsxv3.common.synchronization [req-eae44bc8-9b13-42a1-a355-24ed5e85d11d req-0d9fe83a-399e-4422-8fa7-cca3d088b664 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1123.705887] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc with Priority: HIGHEST for action security_group_members [ 1123.705887] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a362f529-f360-4ab1-9a78-44dfdf9ddecc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.705887] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.705887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.705887] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a362f529-f360-4ab1-9a78-44dfdf9ddecc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.072732] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1124.073322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.208775] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.208936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.209044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.209271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.209364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.209574] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.209719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.209769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.209903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.209979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.210080] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc is going to be updated. [ 1124.238343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.238479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.238621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.238769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.238972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.248124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: IN_PROGRESS for 2s [ 1124.944269] env[65080]: INFO networking_nsxv3.common.synchronization [req-a8827170-26d4-4cf7-8888-6e207cb90e3a req-23b014df-86a2-427f-972b-fd9876f1d115 tempest-ServersTestJSON-683707077 tempest-ServersTestJSON-683707077-project-member] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1124.945397] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGHEST for action security_group_members [ 1124.945759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.945884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.945966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.946160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.946311] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.946413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.946475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.946659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.946693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.946786] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.449482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.449658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.449754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.449951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.450072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.450336] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.450482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.450536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.450722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.450796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.450985] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be updated. [ 1125.480436] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.480590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.480626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.480844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.481363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.491137] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: IN_PROGRESS for 2s [ 1125.936389] env[65080]: INFO networking_nsxv3.common.synchronization [req-b4b98423-009b-4432-8fcc-d1282a77bdff req-10823565-8937-48a1-9181-79f9739b0244 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 1125.937019] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGHEST for action security_group_members [ 1125.938624] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.938802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.938906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.939248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.939508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.939735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.939848] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.940102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.940245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.940398] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.273696] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc in Status: SUCCESS [ 1126.274042] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a362f529-f360-4ab1-9a78-44dfdf9ddecc deletion is rescheduled due to dependency. [ 1126.274042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a362f529-f360-4ab1-9a78-44dfdf9ddecc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.444659] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.444829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.444933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.445801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.445921] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.446255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.446341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.446386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.446567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.446645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.446768] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be updated. [ 1126.480742] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.480992] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.481114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.481424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.481651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.498617] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: IN_PROGRESS for 2s [ 1127.397057] env[65080]: INFO networking_nsxv3.common.synchronization [req-641a39f2-301e-4c58-8ab3-1f3afb0d629c req-5f3ec5c3-4c09-4468-b801-46b53edb319f tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 1127.397966] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGHEST for action security_group_members [ 1127.398823] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.398823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.398823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.399014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.399014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.399158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.399205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.399336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.399415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.399503] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.500679] env[65080]: INFO networking_nsxv3.common.synchronization [req-39a5a52c-e5ff-447a-a84c-38a120fe78e4 req-67d87a84-2794-455d-b73f-7a29cf84052d tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1127.501271] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1127.501551] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.501676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.501743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.502014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.502884] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.503013] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.503098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.503285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.503396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.503506] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.505260] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63c7032c-d9d0-44bc-a95a-298729548f78 in Status: SUCCESS [ 1127.505434] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 deletion is rescheduled due to dependency. [ 1127.505539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.819779] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.820591] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.820790] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.821125] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.821840] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.822015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.822143] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.822380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.822534] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.822732] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.822837] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.822940] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.823058] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.823165] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.823265] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.823397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.842378] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.842551] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.842682] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.842854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-435" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.843292] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-7d9d7ef2-3bea-407a-88d5-92682debaf63 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.843373] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.843476] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.843984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.843984] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d9d7ef2-3bea-407a-88d5-92682debaf63',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.901859] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.902086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.902086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.902312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.902412] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.902752] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.902752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.902752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.902916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.902979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.903075] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e is going to be updated. [ 1127.930407] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.930550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.930688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.930918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.931077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.940521] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: IN_PROGRESS for 2s [ 1127.960582] env[65080]: INFO networking_nsxv3.common.synchronization [req-de655ffa-73a4-4cf3-b2fd-074542faab4f req-7cd89235-f2f5-4d8e-a18b-a9a86f3f20f2 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1127.961258] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1127.961258] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.961522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.961522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.962014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.962014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.962014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.962014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.962234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.962234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.962326] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.008367] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.008367] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.008536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.008689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.008791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.008992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.009111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.009178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.009329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.009407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.009499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 already deleted. [ 1128.009571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.347111] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.347463] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.347606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.348224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.348224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.348364] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 7d9d7ef2-3bea-407a-88d5-92682debaf63 not found, creating... [ 1128.348705] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.348869] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.349012] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.349294] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.349436] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.349800] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.349978] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.350108] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.350331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.350467] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.350606] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 7d9d7ef2-3bea-407a-88d5-92682debaf63 is going to be created. [ 1128.374120] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.374374] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.374467] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.374732] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.374956] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.375416] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.464266] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.464643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.464643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.464715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.464805] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.465031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.465139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.465269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.465395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.465478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.465570] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1128.503333] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.503610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.503743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.503986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.504252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.510450] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 in Status: SUCCESS [ 1128.510664] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 deletion is rescheduled due to dependency. [ 1128.510791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.513472] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [req-39a5a52c-e5ff-447a-a84c-38a120fe78e4 req-fa83d835-5f9d-41f4-b22a-7922b6f5326f service nova] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [req-39a5a52c-e5ff-447a-a84c-38a120fe78e4 req-fa83d835-5f9d-41f4-b22a-7922b6f5326f service nova] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [req-39a5a52c-e5ff-447a-a84c-38a120fe78e4 req-fa83d835-5f9d-41f4-b22a-7922b6f5326f service nova] Enqueued Resource ID: 7d9d7ef2-3bea-407a-88d5-92682debaf63 with Priority: HIGHEST for action port [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_rules [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1129.094947] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9d7ef2-3bea-407a-88d5-92682debaf63 with Priority: HIGHEST for action port [ 1129.097504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.097504] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.097504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.097504] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.097504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.097973] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.098361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d9d7ef2-3bea-407a-88d5-92682debaf63 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.098677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.098677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.098677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.098758] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d9d7ef2-3bea-407a-88d5-92682debaf63',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.273497] env[65080]: INFO networking_nsxv3.common.synchronization [None req-8739d17c-28ce-4d71-bb50-54a9b6898a30 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1129.274657] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1129.275063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.275377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.275377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.275705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.275869] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.369346] env[65080]: INFO networking_nsxv3.common.synchronization [None req-b0fd1c72-fa78-497b-aafe-1c14e8f06120 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1129.369857] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1129.370175] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.370268] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.600692] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.601184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.601184] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.602102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d9d7ef2-3bea-407a-88d5-92682debaf63 with status ACTIVE [ 1129.602293] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.602412] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.602477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.602681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.602771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.602944] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.603060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.603122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.603306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.603391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.603595] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.603689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.603750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.603888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.604018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.604536] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d9d7ef2-3bea-407a-88d5-92682debaf63 is going to be updated. [ 1129.628796] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.628985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.629054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.629301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.629476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.629669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d9d7ef2-3bea-407a-88d5-92682debaf63" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.801899] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.801899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.801899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.802102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.802102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.802196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7175f230-83ec-434e-9455-832730fae510 already deleted. [ 1129.802278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.802434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.802615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.802705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.953110] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e in Status: SUCCESS [ 1129.953301] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e deletion is rescheduled due to dependency. [ 1129.953399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.108023] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.326427] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.326603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.326673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.326923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.327032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.327155] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7175f230-83ec-434e-9455-832730fae510 already deleted. [ 1130.327256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.524727] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1130.524908] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1130.525051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.609820] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.610240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.610240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.610308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.610365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.610476] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 is going to be created. [ 1130.634553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.634745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.634745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.634999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.635235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.646112] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: UNINITIALIZED for 2s [ 1132.658291] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: SUCCESS [ 1132.658841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.658841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.659095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.659297] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.659415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.659478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.659714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.659814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.660186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.660345] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.081425] env[65080]: INFO networking_nsxv3.common.synchronization [None req-68158e8f-1393-4197-a590-495addefdfae tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1133.081425] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1133.081722] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.081776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.082393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.082393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.082393] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.163029] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.169549] env[65080]: INFO networking_nsxv3.common.synchronization [None req-bb12d2a8-f3b0-4422-b569-9d4dacf3eeb0 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1133.170171] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1133.170484] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.170640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.607441] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.607658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.607732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.607929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.608044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.608148] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 already deleted. [ 1133.608232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.608392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.608544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.608649] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.666288] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b03d3f45-f458-4310-b06b-455c69eb8766: rpc.has_security_group_logging(os_id): False [ 1133.689572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.689767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.689903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.690478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.690595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.690894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.690989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.691082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.691262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.691334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.691430] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 is going to be created. [ 1133.750941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.751133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.751178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.751687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.751898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.767945] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: IN_PROGRESS for 2s [ 1134.128429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.128681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.128763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.128972] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.129097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.129196] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 already deleted. [ 1134.129281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.379969] env[65080]: INFO networking_nsxv3.common.synchronization [req-26a89113-27e1-4421-b3d7-9ddc640754ba req-0105e872-a016-41f7-badc-62aecd62f579 tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1135.380509] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1135.380817] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.380939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.381015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.381209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.381356] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.381452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.381549] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.381664] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.381734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.381823] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.685007] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.685303] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.685417] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.685709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.685994] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.686176] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.686313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.686582] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.686753] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.686977] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.687106] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.687217] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.687357] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.687492] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.687590] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.687761] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.708518] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.708704] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.708842] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.709039] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-764" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.709551] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-5e100d9d-3a5e-46b5-94f0-73b51efe296c taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.709551] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.709709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.709998] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.710151] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e100d9d-3a5e-46b5-94f0-73b51efe296c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.780763] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: SUCCESS [ 1135.781077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.884547] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.884726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.884799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.885039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.885138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.885349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.885438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.885503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.885655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.885732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.885818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1135.913804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.913980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.914052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.914239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.914380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.923310] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1135.936118] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.936322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.936444] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.936698] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.936955] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.937231] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.937313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.937667] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.937814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.938032] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.938148] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.938253] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.938358] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.938502] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.938621] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.938750] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.955635] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.956703] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.956703] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.956703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.956703] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.956703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.956703] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.957091] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.957233] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c504c0dc-1089-4b98-8d4a-6d3beddfe99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.213168] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.213168] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.213430] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.214026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.214026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.214026] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 5e100d9d-3a5e-46b5-94f0-73b51efe296c not found, creating... [ 1136.214270] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.214431] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.214550] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.214793] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.214942] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.215295] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.215465] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.215584] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.215796] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.215925] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.216076] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 5e100d9d-3a5e-46b5-94f0-73b51efe296c is going to be created. [ 1136.238510] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.238730] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.238860] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.239176] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.239407] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.239625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.459032] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.459284] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.459387] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.459743] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.459893] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.460080] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port c504c0dc-1089-4b98-8d4a-6d3beddfe99b not found, creating... [ 1136.460311] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.460510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.460583] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.460800] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.460937] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.461259] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.461424] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.461543] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.461748] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.461880] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.462024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b is going to be created. [ 1136.484040] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.484040] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.484040] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.484913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.484913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.485152] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.926440] env[65080]: INFO networking_nsxv3.common.synchronization [req-26a89113-27e1-4421-b3d7-9ddc640754ba req-315a7117-3b40-4b48-88a5-37461117a9f1 service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1136.926621] env[65080]: INFO networking_nsxv3.common.synchronization [req-26a89113-27e1-4421-b3d7-9ddc640754ba req-315a7117-3b40-4b48-88a5-37461117a9f1 service nova] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1136.926756] env[65080]: INFO networking_nsxv3.common.synchronization [req-26a89113-27e1-4421-b3d7-9ddc640754ba req-315a7117-3b40-4b48-88a5-37461117a9f1 service nova] Enqueued Resource ID: 5e100d9d-3a5e-46b5-94f0-73b51efe296c with Priority: HIGHEST for action port [ 1136.927280] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_rules [ 1136.927449] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1136.927556] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e100d9d-3a5e-46b5-94f0-73b51efe296c with Priority: HIGHEST for action port [ 1136.927833] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.927956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.928176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.928443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.928592] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.930329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.930498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.930766] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e100d9d-3a5e-46b5-94f0-73b51efe296c taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.931668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.931780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.932010] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.932148] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e100d9d-3a5e-46b5-94f0-73b51efe296c',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.187711] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a595f6-fb6b-4075-ad88-10b76754d3a7 req-26db92da-88b0-4914-845b-220f41684c4f service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1137.187930] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a595f6-fb6b-4075-ad88-10b76754d3a7 req-26db92da-88b0-4914-845b-220f41684c4f service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1137.188030] env[65080]: INFO networking_nsxv3.common.synchronization [req-84a595f6-fb6b-4075-ad88-10b76754d3a7 req-26db92da-88b0-4914-845b-220f41684c4f service nova] Enqueued Resource ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b with Priority: HIGHEST for action port [ 1137.188631] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1137.188731] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1137.188823] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b with Priority: HIGHEST for action port [ 1137.189335] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.189464] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.189536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.189794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.189899] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.190996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.191125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.191193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.191359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.191505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.191602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.191665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.191806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.191897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.192050] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.193636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.193636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.193636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.193636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.193636] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c504c0dc-1089-4b98-8d4a-6d3beddfe99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.434786] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.434985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.438350] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e100d9d-3a5e-46b5-94f0-73b51efe296c with status ACTIVE [ 1137.438350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.438350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.438350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.439275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.439275] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.439275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.439275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.439275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.439275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.439547] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e100d9d-3a5e-46b5-94f0-73b51efe296c is going to be updated. [ 1137.465476] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.465769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.465769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.465911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.466022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.466181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e100d9d-3a5e-46b5-94f0-73b51efe296c" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.695270] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.699023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.699023] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c504c0dc-1089-4b98-8d4a-6d3beddfe99b with status ACTIVE [ 1137.699023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.699023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.699023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.699023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.699550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.699550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.699550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.699550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.699839] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b is going to be updated. [ 1137.721543] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.721719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.721775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.722057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.722247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.722440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.935185] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1137.935185] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.935185] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.935185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.935185] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.202720] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.438042] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.705712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.706771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.706771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.706771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.706771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.706771] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1138.738280] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.738507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.738507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.738752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.738898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.749282] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1138.940138] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.442889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.443133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.443133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.443299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.443389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.443494] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1139.472613] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.472780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.472878] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.473188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.473364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.482245] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1139.591871] env[65080]: INFO networking_nsxv3.common.synchronization [req-85f9e84f-e366-40a5-b7e5-0f779ebde580 req-3e1b0ecd-66bb-487f-a7de-5597a30bcbe2 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1139.591871] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1139.592228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.592339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.592406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.592649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.592810] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.592904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.592952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.593123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.593209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.593303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.902517] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.902929] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.902929] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.903200] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.903383] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.903545] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.903666] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.903890] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.904032] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.904247] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.904360] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.904466] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.904576] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.904685] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1139.904792] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.904924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.926998] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.927265] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1139.927486] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.927644] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-889" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.927961] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-a24502e7-fad4-4522-ab46-489136f1f920 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.928145] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.928263] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.928628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.928761] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a24502e7-fad4-4522-ab46-489136f1f920',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.097102] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.097289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.097329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.097794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.097794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.097939] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.098023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.098023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.098180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.098258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.098956] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7175f230-83ec-434e-9455-832730fae510 already deleted. [ 1140.098956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.432130] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.432480] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.432558] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.432794] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.432948] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.433119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port a24502e7-fad4-4522-ab46-489136f1f920 not found, creating... [ 1140.433390] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.433548] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.433664] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.433881] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.434030] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.434308] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.434461] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.434576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.434774] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.434906] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.435055] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: a24502e7-fad4-4522-ab46-489136f1f920 is going to be created. [ 1140.455210] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.455613] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.455613] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.455851] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.456141] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.456383] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.617823] env[65080]: INFO networking_nsxv3.common.synchronization [req-b3c3e065-40d0-458b-8f16-791ad03e2e9b req-6c9e228b-81c5-4909-9dde-7fe9fdcb257c tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1140.618517] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1140.618869] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.619012] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.619080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.619297] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.619465] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.619595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.619665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.620559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.620559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.620559] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.760882] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1140.761151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.761315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.761550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.761736] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.761855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.761913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.762083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.762161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.762275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.762345] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.123100] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.123100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.123100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.123100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.123100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.123100] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.123585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.123585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.123585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.123585] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.123585] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1141.154565] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.154761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.154761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.155032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.155163] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.168478] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1141.211717] env[65080]: INFO networking_nsxv3.common.synchronization [req-85f9e84f-e366-40a5-b7e5-0f779ebde580 req-d0cf3884-d9eb-4183-a7eb-b5e0dec1579a service nova] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1141.211892] env[65080]: INFO networking_nsxv3.common.synchronization [req-85f9e84f-e366-40a5-b7e5-0f779ebde580 req-d0cf3884-d9eb-4183-a7eb-b5e0dec1579a service nova] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1141.212073] env[65080]: INFO networking_nsxv3.common.synchronization [req-85f9e84f-e366-40a5-b7e5-0f779ebde580 req-d0cf3884-d9eb-4183-a7eb-b5e0dec1579a service nova] Enqueued Resource ID: a24502e7-fad4-4522-ab46-489136f1f920 with Priority: HIGHEST for action port [ 1141.212593] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_rules [ 1141.212749] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1141.212820] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a24502e7-fad4-4522-ab46-489136f1f920 with Priority: HIGHEST for action port [ 1141.213349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.213675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.213775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.213985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.214074] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.214926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.215083] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.215154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.215319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.215489] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.215593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.215656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.215831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.215916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.216015] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.216826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-a24502e7-fad4-4522-ab46-489136f1f920 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.216955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.217036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.217188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.217264] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a24502e7-fad4-4522-ab46-489136f1f920',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.264997] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.265204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.265267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.265564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.265809] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.265953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.266059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.266267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.266380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.266501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.266719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.266852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.266939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.267135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.267310] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.267427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.267561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.267714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.267792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.267876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.267968] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.495586] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1141.495851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.496055] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.496293] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.496508] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.496637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.496704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.496888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.497031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.497148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.497246] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.719174] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.719864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.719977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.720358] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a24502e7-fad4-4522-ab46-489136f1f920 with status ACTIVE [ 1141.720516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.720617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.720685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.720884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.722119] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.722119] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.722119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.722119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a24502e7-fad4-4522-ab46-489136f1f920 is going to be updated. [ 1141.743066] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.743271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.743271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.743471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.743614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.744135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a24502e7-fad4-4522-ab46-489136f1f920" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.770743] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756: rpc.has_security_group_logging(os_id): False [ 1141.789061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.789234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.789292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.789483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.789803] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.789904] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.789965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.790127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.790206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.790384] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.790476] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.790539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.790674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.790745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.790920] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.791023] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.791076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.791215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.791286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.791372] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1141.885918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.886109] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.886154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.886370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.886513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.893528] env[65080]: INFO networking_nsxv3.common.synchronization [req-3a6133de-cf88-40e3-b555-d92d2ed7a680 req-11a94b8b-e1cc-4f89-b251-0099c2ca43a6 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1141.894135] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1141.894463] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.894837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.894909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.895201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.895464] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.895582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.895665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.895827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.895914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.896025] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.899040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1141.999229] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.999423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.999423] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.999648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.999892] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.000019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.000085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.000243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.000333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.000421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.000576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.000668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.000787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.001116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.001277] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.001374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.001435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.001577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.001658] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.001743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.001837] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.221454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.240035] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.240277] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.240353] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.240641] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.240920] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.241101] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.241218] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.241428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.241563] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.241771] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.241978] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.241978] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.242110] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.242313] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.242313] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.242425] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.268147] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.268650] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.268650] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.268650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.269106] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-1b521847-ee5c-4b20-bc84-db10deabb48a taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.269233] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.269310] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.269704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.269785] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b521847-ee5c-4b20-bc84-db10deabb48a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.398183] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.398335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.398409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.398712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.398809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.399058] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.399162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.399227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.399399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.399477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.399564] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 already deleted. [ 1142.399643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.503599] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d: rpc.has_security_group_logging(os_id): False [ 1142.521227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.521381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.521533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.521685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.521780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.521983] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.522098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.522154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.522300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.522373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.522571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.522679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.522728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.522855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.522920] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.523145] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.523241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.523286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.523430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.523519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.523611] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1142.593953] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.594162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.594232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.594426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.594573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.607264] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1142.724718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.724718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.724718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.724718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.724718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.724979] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7175f230-83ec-434e-9455-832730fae510 is going to be created. [ 1142.751263] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.751344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.751415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.751897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.752095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.766129] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: UNINITIALIZED for 2s [ 1142.771991] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.772253] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.772382] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.772708] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.772863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.773031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 1b521847-ee5c-4b20-bc84-db10deabb48a not found, creating... [ 1142.773316] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.773488] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.773645] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.773934] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.774091] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.774396] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.774560] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.774799] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.774882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.775025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.775169] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 1b521847-ee5c-4b20-bc84-db10deabb48a is going to be created. [ 1142.799684] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.799993] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.800205] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.800493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.800729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.800957] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.179237] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1143.179486] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1143.179486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.527053] env[65080]: INFO networking_nsxv3.common.synchronization [req-3a6133de-cf88-40e3-b555-d92d2ed7a680 req-1ddcf36a-7a25-4e2a-9f0c-f2520479b520 service nova] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1143.527053] env[65080]: INFO networking_nsxv3.common.synchronization [req-3a6133de-cf88-40e3-b555-d92d2ed7a680 req-1ddcf36a-7a25-4e2a-9f0c-f2520479b520 service nova] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1143.527053] env[65080]: INFO networking_nsxv3.common.synchronization [req-3a6133de-cf88-40e3-b555-d92d2ed7a680 req-1ddcf36a-7a25-4e2a-9f0c-f2520479b520 service nova] Enqueued Resource ID: 1b521847-ee5c-4b20-bc84-db10deabb48a with Priority: HIGHEST for action port [ 1143.527638] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1143.527836] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1143.527936] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b521847-ee5c-4b20-bc84-db10deabb48a with Priority: HIGHEST for action port [ 1143.528801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.528801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.528801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.528973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.529063] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.531149] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.531149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.531149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.531149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.531328] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.531328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.531527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.531566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.531654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.531748] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.533768] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b521847-ee5c-4b20-bc84-db10deabb48a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.533891] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.533935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.534506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.534506] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b521847-ee5c-4b20-bc84-db10deabb48a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.912296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1143.912529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.031179] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.031319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.034761] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.035883] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b521847-ee5c-4b20-bc84-db10deabb48a with status ACTIVE [ 1144.036157] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.036290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.036980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.037354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.037542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.037837] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.037960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.038043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.038228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.038341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.038511] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.038628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.038690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.038831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.038905] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.038991] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b521847-ee5c-4b20-bc84-db10deabb48a is going to be updated. [ 1144.068539] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.073409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.073894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.074220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.074416] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.074652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.213783] env[65080]: INFO networking_nsxv3.common.synchronization [req-adba16fb-84dc-4f91-b493-2012de4e8837 req-692928eb-d1a2-4206-8202-4ef33c84137a tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 1144.214382] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 1144.215361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.215498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.215564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.215773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.216530] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.216530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.216530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.216530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.216530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.216793] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.541386] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.631578] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1144.631760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.718986] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.777428] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: SUCCESS [ 1144.777428] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.777674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.777965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.778096] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.778225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.778315] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.778451] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.778542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.778785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.778907] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.043697] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.043897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.043897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.044154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.044247] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.044353] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 is going to be created. [ 1145.068411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.068564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.068662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.068832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.068986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.078346] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: UNINITIALIZED for 2s [ 1145.222074] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.281244] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.726037] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.726037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.726037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.726037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.726037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.726037] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be updated. [ 1145.772897] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.773078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.773151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.773369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.773515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.785685] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 1145.785998] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7175f230-83ec-434e-9455-832730fae510: rpc.has_security_group_logging(os_id): False [ 1145.807859] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.808026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.808131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.808306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.808396] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.809169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.809169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.809169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.809169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.809169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.809169] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7175f230-83ec-434e-9455-832730fae510 is going to be created. [ 1145.880040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.880040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.880040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.880298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.880335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.892688] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: IN_PROGRESS for 2s [ 1146.129671] env[65080]: INFO networking_nsxv3.common.synchronization [None req-6d5c258c-f7d3-480d-b8ad-a7aea0a34b2f tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1146.130366] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1146.130865] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.131076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.131182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.131555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.131694] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.237211] env[65080]: INFO networking_nsxv3.common.synchronization [None req-82d812c0-2946-4e11-ab25-e555684d7841 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1146.239092] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1146.241790] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.241790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.658757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.658987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.658987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.659249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.659350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.659505] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 already deleted. [ 1146.659620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.660011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.660011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.660122] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.102623] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: SUCCESS [ 1147.102952] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.103113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.103449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.103752] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.103887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.103956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.104142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.104229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.104334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.104432] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.180978] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.181158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.181219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.181526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.181617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.181720] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 already deleted. [ 1147.181801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.450162] env[65080]: INFO networking_nsxv3.common.synchronization [req-63f65aa4-8a23-447b-a11b-016d7cb20ed4 req-e00688e5-49e1-4b48-9f13-563a1959970b tempest-ServerDiskConfigTestJSON-2130948900 tempest-ServerDiskConfigTestJSON-2130948900-project-member] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1147.450813] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGHEST for action security_group_members [ 1147.450970] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.451102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.451242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.451369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.451562] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.451718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.451785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.451941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.452214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.452214] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.607146] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.796278] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 1147.796632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.905170] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: SUCCESS [ 1147.905555] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.954227] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.954536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.954691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.955100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.955454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.955691] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.955928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.956071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.956335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.956480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.956903] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be updated. [ 1147.991222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.991386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.991461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.991707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.991871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.001469] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: IN_PROGRESS for 2s [ 1148.110112] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba9250eb-95dc-41eb-aa66-c1eae3283284: rpc.has_security_group_logging(os_id): False [ 1148.131590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.131763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.131817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.132040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.132132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.132386] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.132486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.132599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.132761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.132761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.132875] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 is going to be created. [ 1148.200163] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.200333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.200372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.200659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.200873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.214013] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: IN_PROGRESS for 2s [ 1150.012633] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d in Status: SUCCESS [ 1150.013140] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d deletion is rescheduled due to dependency. [ 1150.013140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.227138] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: SUCCESS [ 1150.227372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.860701] env[65080]: INFO networking_nsxv3.common.synchronization [req-7be4d980-1e90-412c-a274-1ab1832fd260 req-cc03895b-4c40-4dfd-955d-683577b73b06 tempest-ServerRescueNegativeTestJSON-319031549 tempest-ServerRescueNegativeTestJSON-319031549-project-member] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 1150.861806] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGHEST for action security_group_members [ 1150.862073] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.862265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.862372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.862663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.862925] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.863084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.863187] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.863430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.863568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.863725] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.366314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.366647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.366647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.366845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.395063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.395355] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.395484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.395554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.395844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.395932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.396069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be updated. [ 1151.422871] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.423045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.423045] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.423245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.423384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.431899] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: IN_PROGRESS for 2s [ 1152.125794] env[65080]: INFO networking_nsxv3.common.synchronization [req-1fafe4ea-d7b2-4193-91c9-a980e96521d7 req-1ae6f478-aa0b-45af-a1ff-55ed4a999a35 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1152.125794] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1152.125794] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.125925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.125925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.127667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.127863] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.127983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.128063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.128248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.128336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.128435] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.484109] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.484473] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.484655] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.485092] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.485541] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.485826] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.486080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.486461] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.486710] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.487084] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.487311] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.487559] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.487761] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.488007] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.488225] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.488471] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.509553] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.509720] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.509846] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.510052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.510396] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-effc555e-c25f-46b3-8c13-61297a31a99b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.510577] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.510704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.511037] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.511178] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effc555e-c25f-46b3-8c13-61297a31a99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.630998] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.631178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.631178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.631369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.631459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.631656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.631760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.631826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.631956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.632047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.632135] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 already deleted. [ 1152.632216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.014406] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.014660] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.014774] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.015087] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.015247] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.015781] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port effc555e-c25f-46b3-8c13-61297a31a99b not found, creating... [ 1153.015781] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.015921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.016256] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.016553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.016720] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.017103] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.017313] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.017446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.017785] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.017961] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.018151] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: effc555e-c25f-46b3-8c13-61297a31a99b is going to be created. [ 1153.040431] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.040638] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.040764] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.041062] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.041295] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.041544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.442955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc in Status: SUCCESS [ 1153.443181] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc deletion is rescheduled due to dependency. [ 1153.443306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.741658] env[65080]: INFO networking_nsxv3.common.synchronization [req-1fafe4ea-d7b2-4193-91c9-a980e96521d7 req-cdb093c2-de92-48bf-8107-6401084cddc3 service nova] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1153.741913] env[65080]: INFO networking_nsxv3.common.synchronization [req-1fafe4ea-d7b2-4193-91c9-a980e96521d7 req-cdb093c2-de92-48bf-8107-6401084cddc3 service nova] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1153.741945] env[65080]: INFO networking_nsxv3.common.synchronization [req-1fafe4ea-d7b2-4193-91c9-a980e96521d7 req-cdb093c2-de92-48bf-8107-6401084cddc3 service nova] Enqueued Resource ID: effc555e-c25f-46b3-8c13-61297a31a99b with Priority: HIGHEST for action port [ 1153.742475] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_rules [ 1153.742606] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1153.742701] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effc555e-c25f-46b3-8c13-61297a31a99b with Priority: HIGHEST for action port [ 1153.743023] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.743100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.743164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.743359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.743435] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.744617] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.744617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.744617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.744752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.744895] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.744987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.745066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.745205] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.745289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.745376] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.746529] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-effc555e-c25f-46b3-8c13-61297a31a99b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.746640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.746707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.746856] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.746929] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effc555e-c25f-46b3-8c13-61297a31a99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.248878] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.249131] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.249218] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.252524] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effc555e-c25f-46b3-8c13-61297a31a99b with status ACTIVE [ 1154.252765] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.253019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.253099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.253452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.253452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.253742] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.253818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.253908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.254091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.254206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.254434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.254701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.254701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.254797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.254797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.254957] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effc555e-c25f-46b3-8c13-61297a31a99b is going to be updated. [ 1154.278020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.278220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.278220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.278457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.278604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.278840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effc555e-c25f-46b3-8c13-61297a31a99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.449646] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.449879] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.450022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.450331] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.450962] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.451197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.451356] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.451619] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.451791] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.452054] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.452184] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.452325] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.452440] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.452582] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.452695] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.452859] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.473550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.473733] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1154.473869] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.474039] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-880" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.474448] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.474596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.474729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.475012] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.475158] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c504c0dc-1089-4b98-8d4a-6d3beddfe99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.754438] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.977563] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.978236] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.978407] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.978795] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.979015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.979394] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.979618] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.979729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.979974] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.980139] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.980432] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.980586] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.980718] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.980962] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.981114] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.981254] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b is going to be updated. [ 1155.001693] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.001912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.002010] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.002304] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.002502] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.002738] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.256814] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.257082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.257173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.257489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.257686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.257848] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 is going to be created. [ 1155.288434] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.288641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.288750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.289046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.289281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.301871] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: UNINITIALIZED for 2s [ 1155.717323] env[65080]: INFO networking_nsxv3.common.synchronization [req-4735832b-e74c-4cb8-b581-1bd987b133e3 req-f2b36eb4-20af-4d88-abb2-22d0c34d0ac9 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1155.717498] env[65080]: INFO networking_nsxv3.common.synchronization [req-4735832b-e74c-4cb8-b581-1bd987b133e3 req-f2b36eb4-20af-4d88-abb2-22d0c34d0ac9 service nova] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1155.717664] env[65080]: INFO networking_nsxv3.common.synchronization [req-4735832b-e74c-4cb8-b581-1bd987b133e3 req-f2b36eb4-20af-4d88-abb2-22d0c34d0ac9 service nova] Enqueued Resource ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b with Priority: HIGHEST for action port [ 1155.718437] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_rules [ 1155.718557] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1155.718670] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b with Priority: HIGHEST for action port [ 1155.718968] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.719103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.719170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.719364] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.719452] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.720569] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.720712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.720840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.721022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.721233] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.721344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.721459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.721547] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.721636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.721871] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.722710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.722710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.722710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.722845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.722913] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c504c0dc-1089-4b98-8d4a-6d3beddfe99b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.187865] env[65080]: INFO networking_nsxv3.common.synchronization [req-04de2000-03f3-4fa0-b54e-4e82de0f1bb3 req-6cc1ea25-f9a9-4f0b-a4fc-c30ef78efde7 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1156.188434] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1156.188743] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.189022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.189103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.189300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.189460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.189563] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.189625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.189773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.189863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.189967] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.225747] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.225747] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.225747] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.232050] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c504c0dc-1089-4b98-8d4a-6d3beddfe99b with status ACTIVE [ 1156.232050] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.232050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.232050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.232050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.232050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.232317] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.232317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.232317] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.232460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.233980] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.236279] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.236279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.236279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.236434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.236434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.236543] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c504c0dc-1089-4b98-8d4a-6d3beddfe99b is going to be updated. [ 1156.264953] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.264953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.264953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.265158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.265341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.265773] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c504c0dc-1089-4b98-8d4a-6d3beddfe99b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.568040] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.568296] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.568432] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.568688] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.568945] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.569108] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.569224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.569431] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.569591] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.569789] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.569905] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.570024] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.570135] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.570245] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.570349] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.570478] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.590185] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.590378] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.590518] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.590690] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.591090] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9d938196-0927-41da-a529-6cd1b53af669 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.591380] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.591548] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.591992] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.592146] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d938196-0927-41da-a529-6cd1b53af669',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.692291] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.692809] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.694093] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.694093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.694362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.694362] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1156.720831] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.720966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.721060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.721576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.721829] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.727523] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.737563] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1157.094678] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.095198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.095362] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.095706] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.095898] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.096071] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9d938196-0927-41da-a529-6cd1b53af669 not found, creating... [ 1157.096352] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.096511] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.096625] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.096853] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.097070] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.097411] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.097614] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.097789] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.098069] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.098227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.098366] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9d938196-0927-41da-a529-6cd1b53af669 is going to be created. [ 1157.121177] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.121477] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.121610] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.121907] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.122142] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.122372] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.230020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.230347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.230347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.230629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.230744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.230861] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1157.293117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.293117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.293117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.293117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.293117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.305869] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1157.313405] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: SUCCESS [ 1157.313620] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.313787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.314015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.314225] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.314333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.314397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.314568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.314652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.314748] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.314845] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.817689] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.827984] env[65080]: INFO networking_nsxv3.common.synchronization [req-04de2000-03f3-4fa0-b54e-4e82de0f1bb3 req-7cd14217-600d-4570-823b-0c05c21f0c00 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1157.828233] env[65080]: INFO networking_nsxv3.common.synchronization [req-04de2000-03f3-4fa0-b54e-4e82de0f1bb3 req-7cd14217-600d-4570-823b-0c05c21f0c00 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1157.830231] env[65080]: INFO networking_nsxv3.common.synchronization [req-04de2000-03f3-4fa0-b54e-4e82de0f1bb3 req-7cd14217-600d-4570-823b-0c05c21f0c00 service nova] Enqueued Resource ID: 9d938196-0927-41da-a529-6cd1b53af669 with Priority: HIGHEST for action port [ 1157.832110] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1157.832781] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1157.833030] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d938196-0927-41da-a529-6cd1b53af669 with Priority: HIGHEST for action port [ 1157.833406] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.833597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.833706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.833971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.834127] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.835516] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.835618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.835918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d938196-0927-41da-a529-6cd1b53af669 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.836123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.836235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.836645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.836645] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d938196-0927-41da-a529-6cd1b53af669',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.320604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f4be7de-9f2c-448e-9a63-5e62a4a3c678: rpc.has_security_group_logging(os_id): False [ 1158.341848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.342019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.342498] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d938196-0927-41da-a529-6cd1b53af669 with status ACTIVE [ 1158.342498] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.342498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.342676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.342827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.342982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.343328] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.343408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.343452] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.343613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.343698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.343915] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.344047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.344126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.344287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.344395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.344456] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d938196-0927-41da-a529-6cd1b53af669 is going to be updated. [ 1158.349855] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.350103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.350103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.350303] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.350414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.350675] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.350788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.350906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.351017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.353885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.353885] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 is going to be created. [ 1158.386358] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.387013] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.387013] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.387819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.387819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.387819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d938196-0927-41da-a529-6cd1b53af669" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.481954] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.482204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.482276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.482760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.482760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.505124] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: IN_PROGRESS for 2s [ 1158.743788] env[65080]: INFO networking_nsxv3.common.synchronization [None req-1399da86-33b5-4e09-a479-1832238f8e4c None None] Enqueued Resource ID: ec93d104-5f62-4f96-af38-da4fe1acc2ab with Priority: HIGHEST for action port [ 1158.744172] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec93d104-5f62-4f96-af38-da4fe1acc2ab with Priority: HIGHEST for action port [ 1158.744631] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec93d104-5f62-4f96-af38-da4fe1acc2ab taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.745395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec93d104-5f62-4f96-af38-da4fe1acc2ab" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.745395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec93d104-5f62-4f96-af38-da4fe1acc2ab" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.745395] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec93d104-5f62-4f96-af38-da4fe1acc2ab" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.745567] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec93d104-5f62-4f96-af38-da4fe1acc2ab',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.748415] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1158.748747] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1158.748887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.749671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.749896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.750197] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.750393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.750520] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.750862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.751028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.751213] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.248488] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec93d104-5f62-4f96-af38-da4fe1acc2ab [ 1159.248778] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.248967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.249084] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.249353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.249483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.249628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec93d104-5f62-4f96-af38-da4fe1acc2ab already deleted. [ 1159.249778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec93d104-5f62-4f96-af38-da4fe1acc2ab" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.256792] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.324101] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1159.324465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.327076] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.327076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.327076] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.757010] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.830136] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.830346] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.830491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.830706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.830910] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.831035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.831105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.831263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.831350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.831440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.831587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.831677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.831757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.831870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.832016] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.832117] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.832204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.832326] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.832400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.832482] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.832569] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.261423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.261667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.261780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.262138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.262250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.262422] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1160.303432] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.303432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.303432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.303432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.303432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.314401] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1160.335736] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756: rpc.has_security_group_logging(os_id): False [ 1160.359378] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.359378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.359378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.359714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.359714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.359967] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.360154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.360264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.360530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.360656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.361046] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.361150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.361294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.361515] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.362243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.362243] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.362243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.362243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.362656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.362656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.362747] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1160.453448] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.454313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.454313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.454313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.454313] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.479912] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1160.533195] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: SUCCESS [ 1160.533532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.116081] env[65080]: INFO networking_nsxv3.common.synchronization [None req-16b410fd-254d-4e95-b2f7-70b21120c2df None None] Enqueued Resource ID: 588ab8dc-7b44-4d1a-816f-2e76d1d78291 with Priority: HIGHEST for action port [ 1161.116081] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588ab8dc-7b44-4d1a-816f-2e76d1d78291 with Priority: HIGHEST for action port [ 1161.116081] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-588ab8dc-7b44-4d1a-816f-2e76d1d78291 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.116081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-588ab8dc-7b44-4d1a-816f-2e76d1d78291" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.116081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-588ab8dc-7b44-4d1a-816f-2e76d1d78291" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.116311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-588ab8dc-7b44-4d1a-816f-2e76d1d78291" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.116382] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('588ab8dc-7b44-4d1a-816f-2e76d1d78291',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.618549] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 588ab8dc-7b44-4d1a-816f-2e76d1d78291 [ 1161.618850] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.619031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.619031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.619286] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.619398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.619513] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:588ab8dc-7b44-4d1a-816f-2e76d1d78291 already deleted. [ 1161.619617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-588ab8dc-7b44-4d1a-816f-2e76d1d78291" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334417] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.334417] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.334417] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.495066] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1162.495801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.837976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.837976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.837976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.839826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.839826] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.839826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.839826] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.342077] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1163.364040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.364332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.364406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.364715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.364842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.365115] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.365264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.365334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.365471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.365567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.365840] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.365944] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.365994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.366165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.366241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.366442] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.366556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.366638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.366830] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.367026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.367134] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1163.492369] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.493486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.493486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.493486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.493486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.522668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1165.036276] env[65080]: INFO networking_nsxv3.common.synchronization [req-6d450a1a-21a3-4133-9ad6-d1bd852f9ba9 req-bc0a5558-6b4f-4bc3-9b71-aab450ee8c35 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1165.037393] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGHEST for action security_group_members [ 1165.038388] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.038628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.038906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.039199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.039627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.039751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.039751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.039955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.040095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.040285] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.540988] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1165.541245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.543759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.544072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.544072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.544206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.544271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.544486] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.544605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.544667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.544819] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.544896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.544983] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 is going to be updated. [ 1165.570646] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.570646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.570646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.570646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.570646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.581511] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: IN_PROGRESS for 2s [ 1165.721936] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c1f9e9d-1efa-4301-8a9d-4f7d1fd13cbc req-6e978acf-c16f-4829-9065-66647bb239e2 tempest-ServerTagsTestJSON-656526459 tempest-ServerTagsTestJSON-656526459-project-member] Enqueued Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1165.723089] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1165.726689] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.726689] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.726689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.726689] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.155777] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.156129] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-34" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.156198] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-34" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.156462] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-34" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.156716] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.156870] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.156988] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.157217] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.157372] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.157582] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.157694] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.157856] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.157957] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.158080] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.158186] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.158319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.179099] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.179285] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1166.179422] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.179598] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-34" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.179914] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-83d693a2-d10c-454b-a75e-f1a91b416bfd taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.180192] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.180324] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.180639] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.180780] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d693a2-d10c-454b-a75e-f1a91b416bfd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.232020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.232020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.232020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 already deleted. [ 1166.232020] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.683533] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.683753] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.683954] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.684304] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.684553] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.684767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 83d693a2-d10c-454b-a75e-f1a91b416bfd not found, creating... [ 1166.685058] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.685228] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.685339] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.685645] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.685807] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.686104] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.686260] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.686374] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.686583] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.686715] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.686855] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 83d693a2-d10c-454b-a75e-f1a91b416bfd is going to be created. [ 1166.709561] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.709801] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.709927] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.710264] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.710510] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.710752] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.454744] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c1f9e9d-1efa-4301-8a9d-4f7d1fd13cbc req-9d9a73dc-2df7-4259-aa11-f83126633abb service nova] Enqueued Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_rules [ 1167.455030] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c1f9e9d-1efa-4301-8a9d-4f7d1fd13cbc req-9d9a73dc-2df7-4259-aa11-f83126633abb service nova] Enqueued Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1167.455152] env[65080]: INFO networking_nsxv3.common.synchronization [req-1c1f9e9d-1efa-4301-8a9d-4f7d1fd13cbc req-9d9a73dc-2df7-4259-aa11-f83126633abb service nova] Enqueued Resource ID: 83d693a2-d10c-454b-a75e-f1a91b416bfd with Priority: HIGHEST for action port [ 1167.455578] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_rules [ 1167.455742] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1167.455850] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d693a2-d10c-454b-a75e-f1a91b416bfd with Priority: HIGHEST for action port [ 1167.456459] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.456607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.456657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.456916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.457019] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.458140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.458140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.458239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.458470] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.458657] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.458756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.458842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.459050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.459139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.459237] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.460254] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-83d693a2-d10c-454b-a75e-f1a91b416bfd taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.460673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.460746] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.460947] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.461062] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d693a2-d10c-454b-a75e-f1a91b416bfd',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.594996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f360be-120c-440f-9b3c-cb49e640a254 in Status: SUCCESS [ 1167.595256] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 deletion is rescheduled due to dependency. [ 1167.595379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.964025] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.965137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.965137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.965137] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83d693a2-d10c-454b-a75e-f1a91b416bfd with status ACTIVE [ 1167.965444] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.965444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.965537] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.965689] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.965795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.965972] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.966082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.966144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.966314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.966391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.966965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.966965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.966965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.966965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.966965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.966965] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83d693a2-d10c-454b-a75e-f1a91b416bfd is going to be updated. [ 1167.987926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.988107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.988227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.988418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.988559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.988722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83d693a2-d10c-454b-a75e-f1a91b416bfd" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.466257] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.969121] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.969341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.969394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.969683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.969806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.969944] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 is going to be created. [ 1168.995158] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.995358] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.995401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.995714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.995914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.004863] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: UNINITIALIZED for 2s [ 1171.017914] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: SUCCESS [ 1171.018183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.018276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.018519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.018722] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.018846] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.018916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.019128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.019218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.019308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.019412] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.521969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.522208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.522575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.522717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.523064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.523274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.523400] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.523686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.523868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.524052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.524329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.524509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.524632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.525116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.525228] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.525408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.525527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.525782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.525930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.526119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.526299] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.029354] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbb64866-0c3f-4528-b280-a49da99e6643: rpc.has_security_group_logging(os_id): False [ 1172.050971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.051279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.051377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.051530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.051621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.051829] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.052097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.052097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.052236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.052307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.052590] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.052699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.052699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.052824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.052897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.053157] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.053245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.053335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.053445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.053524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.053641] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 is going to be created. [ 1172.121034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.121034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.121034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.121329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.121444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.135317] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: IN_PROGRESS for 2s [ 1172.457659] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.457659] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1173.788981] env[65080]: INFO networking_nsxv3.common.synchronization [req-c1acc1a7-fc36-4ea1-8769-6297e5469690 req-21c48c79-882a-4778-a6f4-10c57bc50801 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1173.789277] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1173.789636] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.789636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.789768] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.789937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.790134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.790240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.790290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.790548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.790604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.791254] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.151600] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: SUCCESS [ 1174.152276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.293880] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.797223] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.048401] env[65080]: INFO networking_nsxv3.common.synchronization [req-40154de0-592a-4971-8d58-e21d19e9f8a8 req-138be6bc-542c-475c-881d-8274b80abfb1 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1175.048401] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1175.048401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.048401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.048818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.048818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.048818] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.049024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.049024] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.049177] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.049263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.049357] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.302031] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.302351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.302509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.302770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.302863] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.302979] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be updated. [ 1175.333581] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.333581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.333581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.333859] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.334091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.345647] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1175.422277] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.422521] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.422593] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.422854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.423225] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.423392] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.423507] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.423734] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.423883] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.425406] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.425406] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.425406] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.425406] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.425406] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.425406] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.425406] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.449207] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.449696] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.449696] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.449696] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.449992] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-39b7c7d4-8d3d-47d5-aeba-302316dc543d taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.450182] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.450301] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.450631] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.450774] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b7c7d4-8d3d-47d5-aeba-302316dc543d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.552776] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.552776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.552776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.553136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.573534] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.573819] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.573941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.574021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.574224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.574309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.574402] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be updated. [ 1175.603772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.603772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.603772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.604015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.604015] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.614723] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 1175.954604] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.954947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.955048] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.955340] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.955493] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.955643] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 39b7c7d4-8d3d-47d5-aeba-302316dc543d not found, creating... [ 1175.956017] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.956196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.956327] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.956544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.956687] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.956963] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.957137] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.957238] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.957437] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.957571] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.957700] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d is going to be created. [ 1175.976969] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.977206] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.977322] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.977594] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.977822] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.978145] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.689019] env[65080]: INFO networking_nsxv3.common.synchronization [req-40154de0-592a-4971-8d58-e21d19e9f8a8 req-450fcdec-344b-49c7-9d01-ef5643832fdd service nova] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_rules [ 1176.689019] env[65080]: INFO networking_nsxv3.common.synchronization [req-40154de0-592a-4971-8d58-e21d19e9f8a8 req-450fcdec-344b-49c7-9d01-ef5643832fdd service nova] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1176.689019] env[65080]: INFO networking_nsxv3.common.synchronization [req-40154de0-592a-4971-8d58-e21d19e9f8a8 req-450fcdec-344b-49c7-9d01-ef5643832fdd service nova] Enqueued Resource ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d with Priority: HIGHEST for action port [ 1176.689019] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_rules [ 1176.689446] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1176.689606] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d with Priority: HIGHEST for action port [ 1176.690080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.690080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.690080] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.690310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.690376] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.691272] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.691376] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.691634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b7c7d4-8d3d-47d5-aeba-302316dc543d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.691734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.691800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.692067] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.692067] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b7c7d4-8d3d-47d5-aeba-302316dc543d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.194635] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.195041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.195174] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39b7c7d4-8d3d-47d5-aeba-302316dc543d with status ACTIVE [ 1177.195361] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.195440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.195760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.195760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.195862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.196128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.196258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.196327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.196533] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.196679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.196936] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.197103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.197215] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.198204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.198204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.198204] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d is going to be updated. [ 1177.220898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.221181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.221299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.221527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.221693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.221895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.362141] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1177.362141] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.625062] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 1177.625062] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e deletion is rescheduled due to dependency. [ 1177.625062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.625351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.625705] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.626255] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.626577] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.626675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.626936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.627274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.627447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.130203] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.632746] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.095341] env[65080]: INFO networking_nsxv3.common.synchronization [req-37b64eb4-06e3-4b70-bf92-0094d4a850cc req-5dc4a168-d315-490a-a591-fc5d64f6df41 tempest-ServerTagsTestJSON-656526459 tempest-ServerTagsTestJSON-656526459-project-member] Enqueued Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1179.095341] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGHEST for action security_group_members [ 1179.095341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.095341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.095341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.095341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.095901] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.096153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.096386] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.096678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.096861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.097127] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.138760] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.138939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.139042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.139258] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.139351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.139495] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be updated. [ 1179.170038] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.170038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.170038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.170038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.170038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.189191] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 1179.600090] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.600261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.600361] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.600599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.600710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.601020] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.601347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.601424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.601597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.601707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.601775] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 is going to be updated. [ 1179.634051] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.634328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.634328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.634940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.634940] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.644854] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: IN_PROGRESS for 2s [ 1180.381926] env[65080]: INFO networking_nsxv3.common.synchronization [req-204e3023-e2d3-47fe-accf-21e5b145a772 req-f5f593a2-273c-40fe-9659-63fbd5199171 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1180.382969] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGHEST for action security_group_members [ 1180.382969] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.382969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.383229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.383229] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.383370] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.383427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.383566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.383629] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.383709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.383806] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.886197] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.886590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.886590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.886665] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.886739] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.886981] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.887112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.887176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.887339] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.887420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.887522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be updated. [ 1180.916040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.916249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.916249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.916475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.916631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.925341] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: IN_PROGRESS for 2s [ 1181.202057] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 1181.202274] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.202426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.202785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.203067] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.203322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.203430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.203667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.203761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.203890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.203964] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.655550] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb64866-0c3f-4528-b280-a49da99e6643 in Status: SUCCESS [ 1181.655758] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 deletion is rescheduled due to dependency. [ 1181.655847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.706743] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.707060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.707060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.707123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.707287] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.707389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.707496] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.707614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.707700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.707803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.707937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.708224] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.708305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.708481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.708648] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.708752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.708818] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.709095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.709272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.709425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.709575] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.211763] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e64e7d9f-cf01-4bec-a794-828cbbadc52e: rpc.has_security_group_logging(os_id): False [ 1182.231862] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.232095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.232095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.232284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.232377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.232609] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.232713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.232776] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.232928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.233016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.233322] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.233524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.233599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.233726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.233803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.233989] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.234174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.234232] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.234531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.234617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.234706] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be updated. [ 1182.329389] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.329648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.329756] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.330059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.330308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.345290] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 1182.936388] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 in Status: SUCCESS [ 1182.936595] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 deletion is rescheduled due to dependency. [ 1182.936707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.360234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 1184.360557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.065575] env[65080]: INFO networking_nsxv3.common.synchronization [req-09edd102-87a7-4e89-9ebf-1b395291eb1b req-7d68afb8-2d61-4424-86cd-2416d894dd92 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1185.066339] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e with Priority: HIGHEST for action security_group_members [ 1185.066678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-e64e7d9f-cf01-4bec-a794-828cbbadc52e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.066803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.066873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.067137] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.067343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.067436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.067467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.067631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.067725] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.067808] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e64e7d9f-cf01-4bec-a794-828cbbadc52e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.112190] env[65080]: INFO networking_nsxv3.common.synchronization [req-09edd102-87a7-4e89-9ebf-1b395291eb1b req-7d68afb8-2d61-4424-86cd-2416d894dd92 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d with Priority: HIGHEST for action port [ 1185.112721] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d with Priority: HIGHEST for action port [ 1185.113047] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b7c7d4-8d3d-47d5-aeba-302316dc543d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.113191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.113261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.113453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.113537] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b7c7d4-8d3d-47d5-aeba-302316dc543d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.571498] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.572075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.572075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.572207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.572243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.572463] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.572582] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.572653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.572808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.572889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.573021] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e is going to be updated. [ 1185.602285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.602285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.602285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.602285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.602523] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.616460] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3f02c817-a49e-4d8e-a1d1-6b8d39db5712 tempest-AttachInterfacesTestJSON-193389306 tempest-AttachInterfacesTestJSON-193389306-project-member] Enqueued Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1185.616460] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39b7c7d4-8d3d-47d5-aeba-302316dc543d with status ACTIVE [ 1185.616460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.616460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.616694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.616988] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.617219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.617587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.617797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.617939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.618241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.618656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.618956] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.619242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.621017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.621017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.621017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.621017] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39b7c7d4-8d3d-47d5-aeba-302316dc543d is going to be updated. [ 1185.621387] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 with Priority: HIGHEST for action security_group_members [ 1185.622371] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: IN_PROGRESS for 2s [ 1185.623098] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.623355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.623521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.623843] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.624117] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.624322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.624498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.625060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.625292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.625507] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.652759] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.652759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.652759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.652759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.652759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.652759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b7c7d4-8d3d-47d5-aeba-302316dc543d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.128576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.129622] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.129622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.130245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.130245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.130643] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 is going to be updated. [ 1186.161965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.162144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.162221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.162477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.162683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.172539] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: IN_PROGRESS for 2s [ 1187.634564] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e in Status: SUCCESS [ 1187.634986] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e64e7d9f-cf01-4bec-a794-828cbbadc52e deletion is rescheduled due to dependency. [ 1187.634986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e64e7d9f-cf01-4bec-a794-828cbbadc52e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.897404] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.897596] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.897717] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.897987] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.898400] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.898577] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.898814] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.899068] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.899222] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.899502] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.899621] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.899731] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.899838] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.899948] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.900064] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.900200] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.919592] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.919756] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1187.919894] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.920085] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-478" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.920499] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-b0f33b73-120f-4ea5-bc9b-184f2034f265 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.920680] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.920799] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.921105] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.921205] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f33b73-120f-4ea5-bc9b-184f2034f265',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.183454] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 in Status: SUCCESS [ 1188.183548] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756 deletion is rescheduled due to dependency. [ 1188.183610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.423749] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.424282] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.424282] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.424460] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.424709] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.425047] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.425224] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.426426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.426426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.426426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.426426] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.426426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.426426] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.426928] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.426928] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.426928] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 is going to be updated. [ 1188.462944] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.462944] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.463168] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.463455] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.463670] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.463909] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.204155] env[65080]: INFO networking_nsxv3.common.synchronization [req-efb11f0a-7101-4471-ae3e-f97f586d336f req-a7e0e894-ca88-40ff-b150-037c8cb4a17e service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 1189.204515] env[65080]: INFO networking_nsxv3.common.synchronization [req-efb11f0a-7101-4471-ae3e-f97f586d336f req-a7e0e894-ca88-40ff-b150-037c8cb4a17e service nova] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1189.204741] env[65080]: INFO networking_nsxv3.common.synchronization [req-efb11f0a-7101-4471-ae3e-f97f586d336f req-a7e0e894-ca88-40ff-b150-037c8cb4a17e service nova] Enqueued Resource ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 with Priority: HIGHEST for action port [ 1189.205649] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_rules [ 1189.205649] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1189.205788] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 with Priority: HIGHEST for action port [ 1189.206198] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.206334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.206404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.206607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.206734] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.207697] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.207784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.207861] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.208657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.208657] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.208657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.208657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.208657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.209196] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.209196] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.210950] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0f33b73-120f-4ea5-bc9b-184f2034f265 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.210950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.210950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.210950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.210950] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f33b73-120f-4ea5-bc9b-184f2034f265',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.712874] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.714563] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.714699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.715184] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0f33b73-120f-4ea5-bc9b-184f2034f265 with status ACTIVE [ 1189.715411] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.716216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.716216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.716216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.716216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.716216] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.716480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.716480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.716628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.716735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.716979] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.717128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.717194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.717383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.717485] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.717603] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0f33b73-120f-4ea5-bc9b-184f2034f265 is going to be updated. [ 1189.747148] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.747397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.747468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.747671] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.747784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.747945] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0f33b73-120f-4ea5-bc9b-184f2034f265" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.216491] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.559612] env[65080]: INFO networking_nsxv3.common.synchronization [None req-e38a917d-f30d-4010-8e8a-808e53a0634a None None] Enqueued Resource ID: 533b5882-9d71-4c99-b818-b041df2205f3 with Priority: HIGHEST for action port [ 1190.560678] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 533b5882-9d71-4c99-b818-b041df2205f3 with Priority: HIGHEST for action port [ 1190.560678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-533b5882-9d71-4c99-b818-b041df2205f3 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.560678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-533b5882-9d71-4c99-b818-b041df2205f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.560678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-533b5882-9d71-4c99-b818-b041df2205f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.560974] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-533b5882-9d71-4c99-b818-b041df2205f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.561079] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('533b5882-9d71-4c99-b818-b041df2205f3',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.719040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.719040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.719040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.719040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.719040] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.719040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1190.747639] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.747883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.748014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.748566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.748826] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.772921] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1191.063111] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 533b5882-9d71-4c99-b818-b041df2205f3 [ 1191.063322] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.063409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.063501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.063755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.063855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.063990] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:533b5882-9d71-4c99-b818-b041df2205f3 already deleted. [ 1191.064090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-533b5882-9d71-4c99-b818-b041df2205f3" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.131276] env[65080]: INFO networking_nsxv3.common.synchronization [req-58c75149-ed81-4cb5-857b-78d01eea02c6 req-80475134-d838-4602-8c4d-1229d938b369 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1191.131883] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1191.132258] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.132501] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.132580] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.132812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.133007] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.133153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.133233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.133407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.133544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.133687] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.638282] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.638750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.638750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.638750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.638941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.639060] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.639161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.639242] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.639404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.639481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.639572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1191.676801] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.676986] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.677041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.677260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.677415] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.687819] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1192.784571] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1192.784571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.784975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.785028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.785234] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.785391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.785479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.785687] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.785795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.786064] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.786190] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.288490] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.705776] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1193.705928] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1193.706051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.790864] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65229547-ee66-4305-8bfe-45dde2354faf: rpc.has_security_group_logging(os_id): False [ 1193.810728] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.810888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.810929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.811179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.811271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.811550] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.811666] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.811727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.811884] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.811975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.812060] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1193.877199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.877354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.877455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.877621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.877763] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.892366] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1195.919967] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1195.920406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.132944] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.133101] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.580199] env[65080]: INFO networking_nsxv3.common.synchronization [req-43ec43ab-ebbe-4cc4-8d90-8fffc935c116 req-3f5ed94d-44f0-4964-b3bb-b724d26955e8 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1198.580676] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1198.581028] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.581150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.581236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.581742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.581742] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.582354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.582354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.582354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.582354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.582512] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.926467] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.926657] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.926781] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.927053] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.927665] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.927832] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.927968] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.928258] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.928414] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.928623] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.928741] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.928857] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.929033] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.929180] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.929332] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.929477] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.951540] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.951760] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.951934] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.952144] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.952494] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-d29b960a-00de-454f-b81d-93bed60b83fc taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.952691] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.952810] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.953268] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.953421] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29b960a-00de-454f-b81d-93bed60b83fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.085478] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.085478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.085478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.085942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.085942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.085942] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.085942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.086129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.086176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.086288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.086397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1199.119048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.119289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.119348] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.119538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.119684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.130380] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1199.456614] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.456827] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.456947] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.457264] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.457421] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.457576] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port d29b960a-00de-454f-b81d-93bed60b83fc not found, creating... [ 1199.457847] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.458098] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.458407] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.458656] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.458861] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.459396] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.459585] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.459706] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.459921] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.460071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.460213] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: d29b960a-00de-454f-b81d-93bed60b83fc is going to be created. [ 1199.482668] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.482899] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.483316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.483462] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.483763] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.484024] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.206547] env[65080]: INFO networking_nsxv3.common.synchronization [req-43ec43ab-ebbe-4cc4-8d90-8fffc935c116 req-1ac6684e-dac1-4c38-9086-f6847dda5020 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1200.206807] env[65080]: INFO networking_nsxv3.common.synchronization [req-43ec43ab-ebbe-4cc4-8d90-8fffc935c116 req-1ac6684e-dac1-4c38-9086-f6847dda5020 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1200.206807] env[65080]: INFO networking_nsxv3.common.synchronization [req-43ec43ab-ebbe-4cc4-8d90-8fffc935c116 req-1ac6684e-dac1-4c38-9086-f6847dda5020 service nova] Enqueued Resource ID: d29b960a-00de-454f-b81d-93bed60b83fc with Priority: HIGHEST for action port [ 1200.207367] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1200.207531] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1200.207618] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29b960a-00de-454f-b81d-93bed60b83fc with Priority: HIGHEST for action port [ 1200.207941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.208595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.208674] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.208895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.208983] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.210695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.210832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.211030] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29b960a-00de-454f-b81d-93bed60b83fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.211150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.211241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.211407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.211491] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29b960a-00de-454f-b81d-93bed60b83fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.713549] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.713761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.713996] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d29b960a-00de-454f-b81d-93bed60b83fc with status ACTIVE [ 1200.714241] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.714390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.714503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.714898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.714898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.715065] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.715218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.715314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.715511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.715621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.715885] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.715993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.716156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.716467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.716675] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.716675] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d29b960a-00de-454f-b81d-93bed60b83fc is going to be updated. [ 1200.739893] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.739893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.739893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.739893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.739893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.739893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29b960a-00de-454f-b81d-93bed60b83fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.140964] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1201.141189] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1201.141312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.141487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.141791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.141991] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.142124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.142243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.142432] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.142517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.142637] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.645642] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.147850] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.651445] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.651817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.651817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.652051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.652203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.652347] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1202.684042] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.684189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.684189] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.684360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.684507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.695044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1204.707348] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1204.707645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.707778] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.708076] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.708289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.708448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.708535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.708743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.708866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.708959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.709097] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.209115] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.209115] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1205.211641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.211781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.211853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.212098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.212286] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.212392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.212455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.212611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.212696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.212784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.212934] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.213039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.213102] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.213245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.213383] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.213473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.213532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.213662] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.213741] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.213817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.213930] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.717044] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1205.735886] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.736129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.736129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.736331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.736421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.736616] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.736719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.736781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.736925] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.737085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.737207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.737298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.737359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.737495] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.737567] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.737780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.737875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.737936] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.738098] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.738170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.738320] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1205.805723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.805960] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.806111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.806448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.806719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.831798] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1207.851234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1207.851598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.030495] env[65080]: INFO networking_nsxv3.common.synchronization [req-a6700da0-3968-4289-8d19-8424afbbae89 req-83e6d348-8855-43c0-aa13-eb0cc2cb568f tempest-ServerActionsTestOtherB-810129265 tempest-ServerActionsTestOtherB-810129265-project-member] Enqueued Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1208.031099] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65229547-ee66-4305-8bfe-45dde2354faf with Priority: HIGHEST for action security_group_members [ 1208.031314] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-65229547-ee66-4305-8bfe-45dde2354faf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.031466] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.031535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.031843] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.031944] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.032087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.032153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.032321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.032435] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.032534] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65229547-ee66-4305-8bfe-45dde2354faf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.467647] env[65080]: INFO networking_nsxv3.common.synchronization [req-4ccb188d-54ad-40d9-920e-c5b3cffc3e87 req-35b81290-4310-4936-989b-9199ff420c75 tempest-AttachVolumeNegativeTest-445547537 tempest-AttachVolumeNegativeTest-445547537-project-member] Enqueued Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1208.468688] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175f230-83ec-434e-9455-832730fae510 with Priority: HIGHEST for action security_group_members [ 1208.469181] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7175f230-83ec-434e-9455-832730fae510 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.469349] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.469403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.469609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.469769] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.469875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.469939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.470113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.470204] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.470303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7175f230-83ec-434e-9455-832730fae510',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.538670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.538670] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.538670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.539329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.539329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.539329] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf is going to be updated. [ 1208.575344] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.575490] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.575586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.575902] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.576081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.597144] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: IN_PROGRESS for 2s [ 1208.935497] env[65080]: INFO networking_nsxv3.common.synchronization [req-5148dcf1-152c-44d9-a5e6-1c0bd7a2ee30 req-3c02b19c-d4c5-4844-a199-e34e4495da4f tempest-AttachVolumeTestJSON-395335117 tempest-AttachVolumeTestJSON-395335117-project-member] Enqueued Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1208.936134] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03d3f45-f458-4310-b06b-455c69eb8766 with Priority: HIGHEST for action security_group_members [ 1208.936493] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b03d3f45-f458-4310-b06b-455c69eb8766 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.936610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.936679] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.936874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.937735] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.937735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.937735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.937735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.937735] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.937735] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b03d3f45-f458-4310-b06b-455c69eb8766',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.973039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.973039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.973039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.973039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.973039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.973039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.973424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.973424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.973424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.973536] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.973587] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7175f230-83ec-434e-9455-832730fae510 is going to be updated. [ 1209.004679] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.004881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.004924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.005174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.005353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.015682] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: IN_PROGRESS for 2s [ 1209.440140] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.440442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.440442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.440593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.440709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.440919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.441036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.441114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.441248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.441327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.441416] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 is going to be updated. [ 1209.471120] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.471332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.471332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.471486] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.471647] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.480911] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: IN_PROGRESS for 2s [ 1210.607646] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65229547-ee66-4305-8bfe-45dde2354faf in Status: SUCCESS [ 1210.608151] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65229547-ee66-4305-8bfe-45dde2354faf deletion is rescheduled due to dependency. [ 1210.608388] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65229547-ee66-4305-8bfe-45dde2354faf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.026930] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7175f230-83ec-434e-9455-832730fae510 in Status: SUCCESS [ 1211.027145] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7175f230-83ec-434e-9455-832730fae510 deletion is rescheduled due to dependency. [ 1211.027243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7175f230-83ec-434e-9455-832730fae510" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.490527] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b03d3f45-f458-4310-b06b-455c69eb8766 in Status: SUCCESS [ 1211.490711] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b03d3f45-f458-4310-b06b-455c69eb8766 deletion is rescheduled due to dependency. [ 1211.490784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b03d3f45-f458-4310-b06b-455c69eb8766" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.877848] env[65080]: INFO networking_nsxv3.common.synchronization [req-c64292eb-39c0-42aa-99d2-80c995ea4e19 req-be18735b-bf52-4515-9bad-c6c68356c5b3 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1211.877848] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1211.877848] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.878651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.878651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.878651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.878651] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.878651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.878651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.879095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.879095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.879095] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.186872] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.187153] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.187354] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.187693] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.187984] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.188207] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.188454] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.188743] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.188941] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.189254] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.189408] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.189541] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.189653] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.189847] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.189971] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.190167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.211238] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.211424] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.211588] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.211778] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-762" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.212138] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.212355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.212512] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.212868] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.213014] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.380757] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.715462] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.715572] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.715672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.715969] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.716147] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.716319] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae not found, creating... [ 1212.716596] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.716758] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.716875] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.717114] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.717250] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.717525] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.717745] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.717973] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.718197] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.718373] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.718515] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae is going to be created. [ 1212.739353] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.739694] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.739847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.740196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.740388] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.740627] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.871986] env[65080]: INFO networking_nsxv3.common.synchronization [req-ccc4e056-8650-426e-bdd8-d6e22c2f7aac req-b6d4b1b8-30a5-4c62-98ef-800edd7ce81d tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1212.872682] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1212.873044] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.873176] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.873244] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.873449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.873610] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.873710] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.873774] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.873918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.874036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.874182] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.883239] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.376902] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.377116] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.377192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.377625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.377762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.378075] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.378287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.378287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.378576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.378646] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.378776] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1213.385787] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.385975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.385975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.386250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.386368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.386499] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1213.424526] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.424697] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.424803] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.425052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.425200] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.440152] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1213.445680] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.445680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.445680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.445680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.445680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.453361] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [req-c64292eb-39c0-42aa-99d2-80c995ea4e19 req-65af8ffd-fd43-4d2c-915b-d5946d42448d service nova] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [req-c64292eb-39c0-42aa-99d2-80c995ea4e19 req-65af8ffd-fd43-4d2c-915b-d5946d42448d service nova] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [req-c64292eb-39c0-42aa-99d2-80c995ea4e19 req-65af8ffd-fd43-4d2c-915b-d5946d42448d service nova] Enqueued Resource ID: 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae with Priority: HIGHEST for action port [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_rules [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1213.511216] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae with Priority: HIGHEST for action port [ 1213.512665] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.515289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.515289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.515289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.515289] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.515289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.515289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.515289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.515289] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.515873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.516237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.516724] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.018722] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.019070] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.019132] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae with status ACTIVE [ 1214.019326] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.019448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.019531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.019772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.019839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.020056] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.020142] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.020213] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.020389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.020389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.020579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.020691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.020743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.020889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.020963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.021057] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae is going to be updated. [ 1214.045739] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.045933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.045933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.046333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.046509] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.046807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ca8a705-c3f7-4d7c-8287-bb2f2c34aaae" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.450808] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1215.451151] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1215.451230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.462872] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1215.463148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.463319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.463553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.463881] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.464041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.464115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.464301] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.464381] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.464621] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.966767] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.469431] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.974926] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.974926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.974926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.974926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.974926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.974926] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1217.011675] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.011852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.011923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.012193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.012344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.023954] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1218.512313] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.512313] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1219.035654] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1219.036035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.036318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.036672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.036976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.037209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.037318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.037573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.037712] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.037834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.037976] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.541261] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.043102] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0ec527d-b1df-4719-9613-729c01dff53d: rpc.has_security_group_logging(os_id): False [ 1220.063437] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.063591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.063663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.063877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.063965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.064234] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.064335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.064399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.064542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.064617] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.064701] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1220.128501] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.128814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.128814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.129062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.129265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.142910] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1222.157271] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1222.157685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.513459] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.513459] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1224.821688] env[65080]: INFO networking_nsxv3.common.synchronization [req-72b4a70a-1967-4e60-a704-97a2c6386492 req-d4b9e7ff-94bc-4847-98cf-91c2375001a2 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1224.822097] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1224.822408] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.822543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.822613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.822806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.822955] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.823072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.823129] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.823270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.823355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.823447] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.096779] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.097055] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.097202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.097452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.097715] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.098316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.098316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.098316] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.098454] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.098724] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1225.098839] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.098945] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.099071] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.099196] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1225.099282] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.099411] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.120930] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.121154] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1225.121294] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.121461] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.121822] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-89bbc0b8-a013-45b8-9ff5-597300050d58 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.121943] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.122059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.122397] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.122546] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bbc0b8-a013-45b8-9ff5-597300050d58',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.325864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.326262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.326262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.326262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.326377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.326579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.326711] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.326769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.326896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.326976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.327076] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1225.351773] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.352019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.352019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.352199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.352337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.360903] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1225.625705] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.626196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.626196] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.627059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.627059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.627059] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 89bbc0b8-a013-45b8-9ff5-597300050d58 not found, creating... [ 1225.627059] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.627363] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.627363] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.627471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.627608] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.628307] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.628307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.628307] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.628576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.628576] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.628640] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 89bbc0b8-a013-45b8-9ff5-597300050d58 is going to be created. [ 1225.652683] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.652683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.652683] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.652982] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.653223] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.653451] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.371621] env[65080]: INFO networking_nsxv3.common.synchronization [req-72b4a70a-1967-4e60-a704-97a2c6386492 req-91e8ca5e-da53-4eea-9251-4d206142e4ca service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1226.371873] env[65080]: INFO networking_nsxv3.common.synchronization [req-72b4a70a-1967-4e60-a704-97a2c6386492 req-91e8ca5e-da53-4eea-9251-4d206142e4ca service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1226.372019] env[65080]: INFO networking_nsxv3.common.synchronization [req-72b4a70a-1967-4e60-a704-97a2c6386492 req-91e8ca5e-da53-4eea-9251-4d206142e4ca service nova] Enqueued Resource ID: 89bbc0b8-a013-45b8-9ff5-597300050d58 with Priority: HIGHEST for action port [ 1226.372194] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1226.372337] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1226.372435] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89bbc0b8-a013-45b8-9ff5-597300050d58 with Priority: HIGHEST for action port [ 1226.372998] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.373457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.373457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.373457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.373587] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.374344] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.374433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.374629] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-89bbc0b8-a013-45b8-9ff5-597300050d58 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.374732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.374797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.375033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.375070] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bbc0b8-a013-45b8-9ff5-597300050d58',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.878911] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89bbc0b8-a013-45b8-9ff5-597300050d58 with status ACTIVE [ 1226.878911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.879234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.879234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.879357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.879392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.879579] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.879691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.879874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.879933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.880047] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.880262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.880394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.880445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.880554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.880634] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.880719] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89bbc0b8-a013-45b8-9ff5-597300050d58 is going to be updated. [ 1226.881899] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.881993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.904553] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.904770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.904770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.904975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.905105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.905266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89bbc0b8-a013-45b8-9ff5-597300050d58" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.371197] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1227.371371] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1227.371484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.371649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.371874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.372039] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.372156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.372217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.372369] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.372445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.372544] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.790022] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.790022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.790022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.790022] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.790022] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.790606] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.793712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.793712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.793712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.793712] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.793712] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.793712] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.793712] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.793712] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.793712] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.793712] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.815031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.815031] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1227.815031] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.815031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-671" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.815031] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-1b521847-ee5c-4b20-bc84-db10deabb48a taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.815031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.815031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.815031] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.815031] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b521847-ee5c-4b20-bc84-db10deabb48a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.878027] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.317859] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.318172] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.318858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.318858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.318858] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.319330] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.320011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.320011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.320011] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.320169] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.320350] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.321017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.321017] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.321125] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.321312] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.321522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 1b521847-ee5c-4b20-bc84-db10deabb48a is going to be updated. [ 1228.347026] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.347964] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.347964] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.348172] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.348469] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.348777] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.381498] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.883725] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.883847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.883847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.884260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.884260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.884260] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1228.921194] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.921355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.921399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.921623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.921769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.937316] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [req-2ea53e76-347e-4640-b900-696516bffbae req-2611f8fa-5424-4360-8572-6d62630fa3cb service nova] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [req-2ea53e76-347e-4640-b900-696516bffbae req-2611f8fa-5424-4360-8572-6d62630fa3cb service nova] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [req-2ea53e76-347e-4640-b900-696516bffbae req-2611f8fa-5424-4360-8572-6d62630fa3cb service nova] Enqueued Resource ID: 1b521847-ee5c-4b20-bc84-db10deabb48a with Priority: HIGHEST for action port [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_rules [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1229.070184] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b521847-ee5c-4b20-bc84-db10deabb48a with Priority: HIGHEST for action port [ 1229.070184] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.070184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.070184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.070797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.071104] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.073261] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.073651] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.073899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.074262] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.074576] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.074831] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.075044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.075311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.075798] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.076028] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.077688] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b521847-ee5c-4b20-bc84-db10deabb48a taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.077975] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.078192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.080133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.080133] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b521847-ee5c-4b20-bc84-db10deabb48a',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.580831] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.582473] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.582473] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.582668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b521847-ee5c-4b20-bc84-db10deabb48a with status ACTIVE [ 1229.582844] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.583060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.583060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.583484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.583484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.583574] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.583681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.583845] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.583931] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.584032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.584290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.584360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.584407] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.584640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.584877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.584877] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b521847-ee5c-4b20-bc84-db10deabb48a is going to be updated. [ 1229.612862] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.613027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.613115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.613337] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.613492] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.613657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b521847-ee5c-4b20-bc84-db10deabb48a" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.086832] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.589677] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.590096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.590219] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.590597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.590771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.590947] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 is going to be updated. [ 1230.619938] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.620149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.620149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.620375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.620546] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.630668] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: IN_PROGRESS for 2s [ 1230.947300] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1230.947606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.947780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.947981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.948188] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.948306] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.948373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.948642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.948686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.948788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.948882] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.451410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.451636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.451696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.452057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.452308] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.452449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.452521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.452722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.452823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.452934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.453163] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.453273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.453356] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.453526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.453762] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.453889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.453963] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.454160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.454248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.454338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.454449] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.956639] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1231.974396] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.974622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.974622] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.974911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.975057] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.975289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.975403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.975471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.975663] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.975769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.976013] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.976133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.976199] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.976344] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.976471] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.976632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.976722] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.976784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.976922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.976997] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.977097] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1232.039507] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.039684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.039726] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.039922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.040081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.059010] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1232.642228] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: SUCCESS [ 1232.642448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.642610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.642840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.643086] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.643170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.643230] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.643384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.643468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.643468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.643687] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.145520] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.648775] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba9250eb-95dc-41eb-aa66-c1eae3283284: rpc.has_security_group_logging(os_id): False [ 1233.669325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.669550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.669550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.669807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.669918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.670207] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.670355] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.670440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.670653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.670755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.670853] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 is going to be updated. [ 1233.743554] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.743811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.743874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.744217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.744438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.765507] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: IN_PROGRESS for 2s [ 1234.070473] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.070473] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1234.078879] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1234.079073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.781928] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: SUCCESS [ 1235.782340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.071690] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.072097] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.185283] env[65080]: INFO networking_nsxv3.common.synchronization [req-91f25261-c173-4364-b90b-1bc4ecf1e471 req-340558c1-d293-4e30-9db4-6f0cf5c5fb9b tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1240.185283] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1240.185283] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.185605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.185605] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.185781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.185925] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.186042] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.186100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.186302] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.186366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.186435] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.688497] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.688626] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.688707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.689053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.689201] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.689446] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.689597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.689761] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.689973] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.690099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.690216] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1240.718430] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.718623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.718816] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.719090] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.719287] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.728487] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1242.742572] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1242.742922] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1242.742922] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.186332] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.186683] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.405030] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.405030] env[65080]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72564f91-5241-4e07-a5c7-69d2a806cb55 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.851275] env[65080]: INFO networking_nsxv3.common.synchronization [req-e66fc1f5-65f1-4d9b-b8f5-5b50d102d9ea req-f6e63c63-9d5c-456e-a48f-3aabfacd0f65 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1248.851482] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1248.851757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.851883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.851950] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.852161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.852313] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.852410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.852489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.852610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.852692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.852785] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.144804] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.145034] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.145164] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.145432] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.145688] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.145846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.145962] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.146195] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.146352] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.146561] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.146676] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.146812] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.146936] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.147063] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.147168] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.147299] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.167589] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.167769] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1249.167909] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.168095] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-601" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.168406] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.168579] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.168697] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.169207] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.169297] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce38ba9-da0e-45ae-aa37-b90bac7e314f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.356429] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.356673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.356673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.356923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.357059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.357287] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.357481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.357481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.357606] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.357681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.357767] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1249.382747] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.382978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.383034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.383263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.383410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.392198] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1249.671747] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.671984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.672111] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.672395] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.672544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.672699] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 9ce38ba9-da0e-45ae-aa37-b90bac7e314f not found, creating... [ 1249.672953] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.673157] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.673273] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.673488] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.673622] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.673994] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.674227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.674358] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.674565] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.674696] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.674832] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 9ce38ba9-da0e-45ae-aa37-b90bac7e314f is going to be created. [ 1249.696236] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.696452] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.696544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.696817] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.697080] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.697317] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.441028] env[65080]: INFO networking_nsxv3.common.synchronization [req-e66fc1f5-65f1-4d9b-b8f5-5b50d102d9ea req-6e1bc403-fc4a-4a09-a2b5-007c705b2d81 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1250.441028] env[65080]: INFO networking_nsxv3.common.synchronization [req-e66fc1f5-65f1-4d9b-b8f5-5b50d102d9ea req-6e1bc403-fc4a-4a09-a2b5-007c705b2d81 service nova] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1250.441028] env[65080]: INFO networking_nsxv3.common.synchronization [req-e66fc1f5-65f1-4d9b-b8f5-5b50d102d9ea req-6e1bc403-fc4a-4a09-a2b5-007c705b2d81 service nova] Enqueued Resource ID: 9ce38ba9-da0e-45ae-aa37-b90bac7e314f with Priority: HIGHEST for action port [ 1250.441512] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_rules [ 1250.441656] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1250.441797] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce38ba9-da0e-45ae-aa37-b90bac7e314f with Priority: HIGHEST for action port [ 1250.442043] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.442223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.442223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.442418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.442498] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.443423] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443565] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.443714] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443812] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.443877] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.444078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.444172] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce38ba9-da0e-45ae-aa37-b90bac7e314f',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.946420] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.946667] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.946811] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ce38ba9-da0e-45ae-aa37-b90bac7e314f with status ACTIVE [ 1250.946988] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.948044] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.948044] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.948596] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.948596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.948596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.948596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.948596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.948596] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ce38ba9-da0e-45ae-aa37-b90bac7e314f is going to be updated. [ 1250.970710] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.970946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.970946] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.971140] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.971279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.971442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ce38ba9-da0e-45ae-aa37-b90bac7e314f" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.403306] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1251.403512] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1251.403604] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.403771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.404014] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.404268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.404385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.404421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.404560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.404642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.404741] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.552298] env[65080]: INFO networking_nsxv3.common.synchronization [req-537592f3-09bd-4905-81b0-b3b8d173bd00 req-c80a2b7b-6901-41d2-a813-89748f0a0df8 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1251.552867] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGHEST for action security_group_members [ 1251.553204] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.553325] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.553392] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.553586] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.553739] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.553888] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.553939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.554104] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.554161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.554290] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.907427] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.056338] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.056532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.056532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.056701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.056828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.056985] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.057094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.057164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.057314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.057391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.057479] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 is going to be updated. [ 1252.082222] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.082448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.082448] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.082603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.082742] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.090701] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: IN_PROGRESS for 2s [ 1252.409947] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.912401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.912713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.912713] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.912851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.912942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.913056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1252.945034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.945210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.945295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.945453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.945595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.953788] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1254.100219] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 in Status: SUCCESS [ 1254.100559] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 deletion is rescheduled due to dependency. [ 1254.100559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.963301] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1254.963544] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.963704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.963923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.964131] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.964246] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.964310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.964457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.964540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.964624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.964718] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.467446] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.467446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.467911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.467911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.467911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.468053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.468092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.468214] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.468300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.468387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.468532] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.468625] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.468751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.468827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.468967] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.469066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.469126] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.469261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.469334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.469414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.469503] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.971826] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1255.990658] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.990879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.990879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.991166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.991281] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.991510] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.991635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.991707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.992052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.992052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.992165] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.992251] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.992332] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.992480] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.992556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.992746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.992883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.992971] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.993185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.993275] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.993366] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1256.061333] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.061511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.061553] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.061842] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.062035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.092604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1256.554384] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1256.554784] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.110682] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1258.111077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.555200] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.555580] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.556031] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.556377] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.557482] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1271.557848] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.349223] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.349529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.349529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.349688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.349803] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.853061] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.355060] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.857261] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1275.857448] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1276.558104] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.558397] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.703326] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.703559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.703559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.703766] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.715149] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1276.716032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.717069] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1276.754164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.754404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.754404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.754576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.767660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.768490] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1276.768584] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.768671] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1276.814343] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.814619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.814672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.815234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.816307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.816555] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1276.893785] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.894033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.894033] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.894174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.894504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.894793] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1276.974555] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.974793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.974793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.974955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.975284] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.975604] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1276.975699] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f218e741-66ae-4212-b505-022023a657a5', '69bf0a4d-c007-4a2a-a34e-6cb212b0693e', '7f4be7de-9f2c-448e-9a63-5e62a4a3c678', 'd0ec527d-b1df-4719-9613-729c01dff53d', '66ac16de-c17b-4005-aa11-407133216460', 'cdf55eea-7c35-4863-963a-9034c2b5fa2d', 'd629476b-3a70-4bd5-b609-8de4bbdf5113', '0c50e85f-a159-417f-9f39-2a4536a3d1f9', 'dbb64866-0c3f-4528-b280-a49da99e6643', '4fdd5826-7c9a-4cc6-a81b-59df4cf76173', 'a1f360be-120c-440f-9b3c-cb49e640a254', '30779562-35b9-47db-9f9a-0150e8c2a1fc', '78fc59d1-2dfd-4052-b838-ea0677bb6950', '63c7032c-d9d0-44bc-a95a-298729548f78', '74ec0c67-3f18-478e-834a-86d63bd247dc', '6825ea0a-b872-4921-b4ff-cfadbcf5f615', '354ecbf4-79a8-4770-9da4-7284d1f205e7', 'ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d', '5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0', 'c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9', 'f57ff6ba-bba7-4f43-bf2f-98942bd9fa5f', '8ff651ba-db91-4903-b7c9-61210ba27bf2', 'ba9250eb-95dc-41eb-aa66-c1eae3283284', '65229547-ee66-4305-8bfe-45dde2354faf', '05b95378-31e5-4020-807b-04d9b89c292b', '9e59560e-07cb-4010-9db4-01e08b7a2a6f', '2314d2a9-c4bd-47c8-8042-e43fbe76d252', 'defc6278-7bc8-46f9-a983-ce92624f663f', 'a0d0d6dc-4a67-4615-9a0e-e07f2ff9a957', '409c4860-3410-423b-b6d1-e6ef10d36332', 'b03d3f45-f458-4310-b06b-455c69eb8766', '139f1c3c-a779-4214-88d4-1b7cd2dfa63a', 'a362f529-f360-4ab1-9a78-44dfdf9ddecc', '9f26b803-17d9-4a38-b02c-de9324967417', 'bdc0dbc8-d315-4ee4-b6ea-e65ee4d41756', '7175f230-83ec-434e-9455-832730fae510', 'f37e842d-6cd4-418f-bbf9-d080ba3516d1', 'b73fffa1-5944-4b18-a4a3-4524859f2a56', '469659aa-55ee-4417-af33-cbcc618456d1', '1f5d56a6-c880-45fc-9906-c91296be3017', '368f5d0c-dc76-4d4f-b69c-1d60821659c2', 'e64e7d9f-cf01-4bec-a794-828cbbadc52e'} {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.975785] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1276.993609] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.993814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.993814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.993994] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.994092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.994203] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1276.994275] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.994346] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1277.149422] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.149643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.149643] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.149832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.151028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.151305] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1277.151387] env[65080]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65080) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.151460] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1277.151528] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1277.151610] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1277.151680] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGH for action security_group_rules [ 1277.151758] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGH for action security_group_rules [ 1277.151824] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGH for action security_group_rules [ 1277.151886] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 1277.151948] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGH for action security_group_rules [ 1277.152024] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGH for action security_group_rules [ 1277.152079] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGH for action security_group_rules [ 1277.152138] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGH for action security_group_rules [ 1277.152202] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGH for action security_group_rules [ 1277.152264] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGH for action security_group_rules [ 1277.152326] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGH for action security_group_rules [ 1277.152388] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGH for action security_group_rules [ 1277.152450] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGH for action security_group_rules [ 1277.152511] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGH for action security_group_rules [ 1277.152571] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGH for action security_group_rules [ 1277.152632] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGH for action security_group_rules [ 1277.152694] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGH for action security_group_rules [ 1277.152756] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGH for action security_group_rules [ 1277.152818] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGH for action security_group_rules [ 1277.152879] env[65080]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGH for action security_group_rules [ 1277.152976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.559527] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.559924] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1281.559924] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f218e741-66ae-4212-b505-022023a657a5 with Priority: HIGH for action security_group_rules [ 1281.559924] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 with Priority: HIGH for action security_group_rules [ 1281.560078] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 with Priority: HIGH for action security_group_rules [ 1281.560113] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74ec0c67-3f18-478e-834a-86d63bd247dc with Priority: HIGH for action security_group_rules [ 1281.560207] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGH for action security_group_rules [ 1281.560270] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 with Priority: HIGH for action security_group_rules [ 1281.560368] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d with Priority: HIGH for action security_group_rules [ 1281.560502] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 with Priority: HIGH for action security_group_rules [ 1281.560610] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c7032c-d9d0-44bc-a95a-298729548f78 with Priority: HIGH for action security_group_rules [ 1281.560727] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 with Priority: HIGH for action security_group_rules [ 1281.560821] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 with Priority: HIGH for action security_group_rules [ 1281.560913] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc with Priority: HIGH for action security_group_rules [ 1281.561021] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f360be-120c-440f-9b3c-cb49e640a254 with Priority: HIGH for action security_group_rules [ 1281.561124] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 with Priority: HIGH for action security_group_rules [ 1281.561215] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb64866-0c3f-4528-b280-a49da99e6643 with Priority: HIGH for action security_group_rules [ 1281.561304] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGH for action security_group_rules [ 1281.561394] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 with Priority: HIGH for action security_group_rules [ 1281.561483] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ac16de-c17b-4005-aa11-407133216460 with Priority: HIGH for action security_group_rules [ 1281.561571] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e with Priority: HIGH for action security_group_rules [ 1281.561661] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGH for action security_group_rules [ 1281.562018] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f218e741-66ae-4212-b505-022023a657a5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.562202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.562285] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.562531] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.562614] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f218e741-66ae-4212-b505-022023a657a5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.563614] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.563755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.564336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.564336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.564336] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4be7de-9f2c-448e-9a63-5e62a4a3c678',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.566700] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629476b-3a70-4bd5-b609-8de4bbdf5113 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.566836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.566895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.567069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.567203] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629476b-3a70-4bd5-b609-8de4bbdf5113',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.568059] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74ec0c67-3f18-478e-834a-86d63bd247dc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.568188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.568250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.568403] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.568477] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74ec0c67-3f18-478e-834a-86d63bd247dc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.569224] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.569330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.569401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.569543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.569653] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.570304] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.570413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.570463] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.570615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.570688] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.571509] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.571619] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.571686] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.571833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.571903] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.572642] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354ecbf4-79a8-4770-9da4-7284d1f205e7 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.572743] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.572801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.572951] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.573032] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354ecbf4-79a8-4770-9da4-7284d1f205e7',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.573694] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63c7032c-d9d0-44bc-a95a-298729548f78 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.573840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.573919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.574467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.575077] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63c7032c-d9d0-44bc-a95a-298729548f78',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.575727] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.576019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.576019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.576169] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.576283] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6825ea0a-b872-4921-b4ff-cfadbcf5f615',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.576941] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc59d1-2dfd-4052-b838-ea0677bb6950 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.577052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.577134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.577261] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.577337] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc59d1-2dfd-4052-b838-ea0677bb6950',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.578918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30779562-35b9-47db-9f9a-0150e8c2a1fc taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.578918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.578918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.578918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.578918] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30779562-35b9-47db-9f9a-0150e8c2a1fc',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.579300] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f360be-120c-440f-9b3c-cb49e640a254 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.579300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.579300] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.579750] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.579750] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f360be-120c-440f-9b3c-cb49e640a254',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.580119] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.580278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.580278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.580461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.580957] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdd5826-7c9a-4cc6-a81b-59df4cf76173',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.581290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb64866-0c3f-4528-b280-a49da99e6643 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.581401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.581457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.581597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.581958] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb64866-0c3f-4528-b280-a49da99e6643',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.582324] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.582657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.582657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.582657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.582820] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.583366] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.583478] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.583781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.583781] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.583781] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c50e85f-a159-417f-9f39-2a4536a3d1f9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.584494] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66ac16de-c17b-4005-aa11-407133216460 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.584621] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.584688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.584794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.584868] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66ac16de-c17b-4005-aa11-407133216460',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.585518] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.585642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.585709] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.585832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.585919] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69bf0a4d-c007-4a2a-a34e-6cb212b0693e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.586686] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.586775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.586775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.586937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.587116] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.612685] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.612804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.612864] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.613105] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.634678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.634914] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629476b-3a70-4bd5-b609-8de4bbdf5113 is going to be deleted. [ 1281.683285] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.683543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.683543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.683683] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.683772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.683897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629476b-3a70-4bd5-b609-8de4bbdf5113" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.102119] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.102347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.102347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.102500] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.102657] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.102752] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.102814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.102959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.103061] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.103147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.103234] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.106407] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.106543] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.106612] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.106777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.106912] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.107039] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.107152] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.107216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.107292] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.107378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.107461] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.111638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.111823] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.111927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.112118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.112271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.112370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.112433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.112573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.112652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.112734] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.112817] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.166992] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.167221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.167221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.167421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.169768] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.169967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.170965] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.171097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.171802] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.171909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.172606] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.172696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.173397] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.173489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.174268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.174362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.175080] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.175190] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.175834] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.175928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.177084] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.177188] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.177930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.178038] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.178676] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.179126] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.179225] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.179865] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.180246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.180341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.181031] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.181341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.181446] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.182038] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.182438] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.182542] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.183157] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.183552] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.183668] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.186453] env[65080]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1282.186875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.186986] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f360be-120c-440f-9b3c-cb49e640a254 is going to be deleted. [ 1282.187959] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.188052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.204065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.204219] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb64866-0c3f-4528-b280-a49da99e6643 is going to be deleted. [ 1282.205095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.205311] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.230075] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.230206] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354ecbf4-79a8-4770-9da4-7284d1f205e7 is going to be deleted. [ 1282.231111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.231333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.249780] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.250027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.258368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.258688] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66ac16de-c17b-4005-aa11-407133216460 is going to be deleted. [ 1282.259780] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.260018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.280318] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.280521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.282065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.282216] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6825ea0a-b872-4921-b4ff-cfadbcf5f615 is going to be deleted. [ 1282.283195] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.283491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.292040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.292265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.324270] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.324458] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63c7032c-d9d0-44bc-a95a-298729548f78 is going to be deleted. [ 1282.325738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.325738] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.359440] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.359592] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4be7de-9f2c-448e-9a63-5e62a4a3c678 is going to be deleted. [ 1282.360507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.360802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.389845] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.390036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.430632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.430794] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f218e741-66ae-4212-b505-022023a657a5 is going to be deleted. [ 1282.431824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.432082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.459913] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.460103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.460797] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.460887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.517602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.517760] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdd5826-7c9a-4cc6-a81b-59df4cf76173 is going to be deleted. [ 1282.518677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.519179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.544869] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.545052] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.550435] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.550578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.575875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.576280] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74ec0c67-3f18-478e-834a-86d63bd247dc is going to be deleted. [ 1282.576989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.577272] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.610934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.611257] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69bf0a4d-c007-4a2a-a34e-6cb212b0693e is going to be deleted. [ 1282.612318] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.612631] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.615596] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.620581] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.620720] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.620789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.621016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.621290] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.621290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.621397] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.621548] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.621635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.621714] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.621860] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.621953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.622026] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.622170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.622308] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.622399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.622460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.622593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.622670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.622764] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.622855] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.624043] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.648744] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.648981] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d is going to be deleted. [ 1282.651343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.651574] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.654674] env[65080]: INFO networking_nsxv3.common.synchronization [req-a5e5bb69-9027-4075-a036-d4438ea46f16 req-98808ace-79c2-4ccd-9585-bd62111d3439 tempest-AttachVolumeShelveTestJSON-1545661731 tempest-AttachVolumeShelveTestJSON-1545661731-project-member] Enqueued Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1282.655699] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 with Priority: HIGHEST for action security_group_members [ 1282.656206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba9250eb-95dc-41eb-aa66-c1eae3283284 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.656206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.656335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.656445] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.656599] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.656699] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.656772] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.657910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.657910] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.657910] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba9250eb-95dc-41eb-aa66-c1eae3283284',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.681632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.681871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.703495] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.703618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.745760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.745816] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc59d1-2dfd-4052-b838-ea0677bb6950 is going to be deleted. [ 1282.746868] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.747149] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.768779] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.768982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.777178] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.777320] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0 is going to be deleted. [ 1282.778216] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.778429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.817359] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.817359] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.829077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.829077] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30779562-35b9-47db-9f9a-0150e8c2a1fc is going to be deleted. [ 1282.829077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.829077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.870427] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.870650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.885377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.885377] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c50e85f-a159-417f-9f39-2a4536a3d1f9 is going to be deleted. [ 1282.886491] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.886817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.886942] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887192] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f360be-120c-440f-9b3c-cb49e640a254" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.887639] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.887696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.887862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb64866-0c3f-4528-b280-a49da99e6643" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.888468] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.889112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.889267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354ecbf4-79a8-4770-9da4-7284d1f205e7" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.889610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.889832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.889941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.890111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66ac16de-c17b-4005-aa11-407133216460" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.890433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.890510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.890653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.890808] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63c7032c-d9d0-44bc-a95a-298729548f78" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.891018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.891237] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.891375] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.891529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6825ea0a-b872-4921-b4ff-cfadbcf5f615" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.891727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.891912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.892056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.892222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f218e741-66ae-4212-b505-022023a657a5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.892434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.892637] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.892874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.892933] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4be7de-9f2c-448e-9a63-5e62a4a3c678" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.893101] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.893308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.893424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.893596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdd5826-7c9a-4cc6-a81b-59df4cf76173" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.893824] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.893966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.894153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.894278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74ec0c67-3f18-478e-834a-86d63bd247dc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.894461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.894660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.894775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.894956] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69bf0a4d-c007-4a2a-a34e-6cb212b0693e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.895203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.895420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.895616] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.895745] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab49ad5a-3de4-445b-ab9c-fa77d5e60e8d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.895908] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.896100] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.896186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.896338] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc59d1-2dfd-4052-b838-ea0677bb6950" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.926864] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.927063] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.927119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.927310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.927402] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.927521] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5db9f0ef-d719-4c13-9c1e-b4f0e1bd65e0" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.940627] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.940791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.940841] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.941066] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.941167] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.941294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30779562-35b9-47db-9f9a-0150e8c2a1fc" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.997736] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.997899] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.997993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.998227] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.998320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.998459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c50e85f-a159-417f-9f39-2a4536a3d1f9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.117651] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf55eea-7c35-4863-963a-9034c2b5fa2d: rpc.has_security_group_logging(os_id): False [ 1283.126707] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9: rpc.has_security_group_logging(os_id): False [ 1283.127951] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0ec527d-b1df-4719-9613-729c01dff53d: rpc.has_security_group_logging(os_id): False [ 1283.154505] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.154733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.154733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.154928] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.156689] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.156850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.159083] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.159260] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.159478] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.159566] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.189793] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.190246] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.190449] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.190529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.190769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.190883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.191040] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1283.192484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.192704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.217791] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.218115] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.218279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.218350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.218564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.218653] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.218870] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.218976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.219032] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.219299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.219372] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.219521] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.219599] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.219660] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.219799] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.219873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.219963] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1283.221160] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.221324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.244731] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.244996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.245138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.245208] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.245421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.245541] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.245680] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 is going to be updated. [ 1283.246641] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.246817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.274642] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.275064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.275203] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.275265] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.275498] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.275591] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.275684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1283.290321] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.290513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.290513] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.290700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.290874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.303959] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.304183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.304264] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.304494] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.304645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.306651] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: IN_PROGRESS for 2s [ 1283.311398] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.311564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.311635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.311837] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.311979] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.325362] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1283.526885] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1283.527819] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.527961] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.528123] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.528283] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.528453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.546119] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1285.226661] env[65080]: INFO networking_nsxv3.common.synchronization [req-b239e300-14f6-48e1-b249-08df6e0ba0bc req-a4630e96-fef9-44ad-9e8a-e208b79bfafb tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1285.227183] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1285.227382] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.227499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.227570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.227754] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.227904] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.228166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.228166] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.228282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.228282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.228398] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.320097] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 in Status: SUCCESS [ 1285.320374] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba9250eb-95dc-41eb-aa66-c1eae3283284 deletion is rescheduled due to dependency. [ 1285.320569] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba9250eb-95dc-41eb-aa66-c1eae3283284" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.337421] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1285.337672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.545911] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1285.545911] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.558410] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1285.558410] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.731103] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.731263] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.731333] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.731628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.731749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.731961] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.732078] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.732133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.732305] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.732368] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.732471] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1285.761633] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.761853] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.761934] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.762170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.762321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.771113] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1287.783029] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1287.783297] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d deletion is rescheduled due to dependency. [ 1287.783351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.766362] env[65080]: INFO networking_nsxv3.common.synchronization [req-853389d0-4e15-4a1b-9b5f-586705f2ba14 req-5caf1826-b172-4621-90cf-035fc27a9f51 tempest-DeleteServersTestJSON-500104849 tempest-DeleteServersTestJSON-500104849-project-member] Enqueued Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1288.766884] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 with Priority: HIGHEST for action security_group_members [ 1288.767889] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.768028] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.768099] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.768295] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.769587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.769723] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.769785] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.769967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.770073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.770201] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.857912] env[65080]: INFO networking_nsxv3.common.synchronization [req-93d97932-b337-4c40-8bcd-ae23d60b2079 req-0a165934-d9b4-49c9-aecb-aff3fb68c3d6 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1288.858680] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1288.859937] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.859937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.859937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.860259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.860475] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.860595] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.860661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.860876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.860981] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.861143] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.272460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.272694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.272694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.272875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.272976] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.273195] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.273408] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.273507] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.274056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.274056] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.274056] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 is going to be updated. [ 1289.302638] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.302852] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.302894] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.303122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.303304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.313728] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: IN_PROGRESS for 2s [ 1289.363558] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.866193] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.368713] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.368939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.368939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.369271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.369454] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.369597] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1290.397525] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.397794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.397794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.397930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.398081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.406977] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1291.325648] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 in Status: SUCCESS [ 1291.326169] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9 deletion is rescheduled due to dependency. [ 1291.326329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c34a8e2c-f2c9-4b69-b84f-c7520b65c2b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.417282] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1292.417602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.479994] env[65080]: INFO networking_nsxv3.common.synchronization [req-032309cb-53e0-4814-a355-0121db56e8f3 req-d7448bb5-8b63-470e-84ae-cffffdf05098 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1292.480616] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1292.481267] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.481623] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.482253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.482253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.482253] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.482253] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.482554] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.482695] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.482760] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.482885] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.766828] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.766828] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.767049] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.767261] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.767521] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.767679] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.767794] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.768026] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.768171] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.768403] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.768517] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.768623] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.768728] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.768834] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.768935] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.769074] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.794927] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.795141] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.795242] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.795428] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.795858] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-fe274522-0454-4db9-90af-4b6bf2f4d0b9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.796102] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.796252] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.796607] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.796750] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe274522-0454-4db9-90af-4b6bf2f4d0b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.985607] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.985715] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.985965] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.986041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.986174] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.986814] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.986814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.986814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.986814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.986814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.987143] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1293.017260] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.017455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.017455] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.017669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.017814] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.031618] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1293.300925] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.301221] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.301288] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.302081] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.302081] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.302081] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port fe274522-0454-4db9-90af-4b6bf2f4d0b9 not found, creating... [ 1293.302343] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.302343] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.302446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.302644] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.302784] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.303079] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.303227] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.303347] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.303565] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.303696] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.303967] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: fe274522-0454-4db9-90af-4b6bf2f4d0b9 is going to be created. [ 1293.328167] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.328459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.328602] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.328945] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.329266] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.329527] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.022762] env[65080]: INFO networking_nsxv3.common.synchronization [req-032309cb-53e0-4814-a355-0121db56e8f3 req-8cf61ae6-90e2-49e2-9ec4-a1cc4cdeb91c service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 1294.023092] env[65080]: INFO networking_nsxv3.common.synchronization [req-032309cb-53e0-4814-a355-0121db56e8f3 req-8cf61ae6-90e2-49e2-9ec4-a1cc4cdeb91c service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1294.023440] env[65080]: INFO networking_nsxv3.common.synchronization [req-032309cb-53e0-4814-a355-0121db56e8f3 req-8cf61ae6-90e2-49e2-9ec4-a1cc4cdeb91c service nova] Enqueued Resource ID: fe274522-0454-4db9-90af-4b6bf2f4d0b9 with Priority: HIGHEST for action port [ 1294.024181] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 1294.024408] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1294.024618] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe274522-0454-4db9-90af-4b6bf2f4d0b9 with Priority: HIGHEST for action port [ 1294.025064] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.025273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.025425] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.025729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.025877] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.028026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.028124] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.028349] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe274522-0454-4db9-90af-4b6bf2f4d0b9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.028472] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.028719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.028917] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.029038] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe274522-0454-4db9-90af-4b6bf2f4d0b9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.530522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe274522-0454-4db9-90af-4b6bf2f4d0b9 with status ACTIVE [ 1294.530739] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.530901] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.530982] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.531198] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.531290] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.531470] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.531581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.531684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.531813] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.531893] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.532137] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.532243] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.532299] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.532443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.532545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.532635] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe274522-0454-4db9-90af-4b6bf2f4d0b9 is going to be updated. [ 1294.534198] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.534291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.556509] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.556727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.556727] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.556929] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.557073] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.557273] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe274522-0454-4db9-90af-4b6bf2f4d0b9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.043200] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1295.043512] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d deletion is rescheduled due to dependency. [ 1295.043512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.043784] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.044136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.044626] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.044915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.044915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.045197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.045310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.045440] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.547816] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.051527] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.554967] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.554967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.554967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.554967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.554967] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.554967] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1296.585788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.585788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.585788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.585788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.585788] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.594927] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1298.613387] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.613387] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613387] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.025590] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.025700] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.114332] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.485947] env[65080]: INFO networking_nsxv3.common.synchronization [None req-3ae605de-471e-46f6-b45b-9135af7c3d77 None None] Enqueued Resource ID: fc9b590a-4586-4324-a91b-6632797e92cf with Priority: HIGHEST for action port [ 1299.486431] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9b590a-4586-4324-a91b-6632797e92cf with Priority: HIGHEST for action port [ 1299.486737] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9b590a-4586-4324-a91b-6632797e92cf taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.486851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9b590a-4586-4324-a91b-6632797e92cf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.486932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9b590a-4586-4324-a91b-6632797e92cf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.487217] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9b590a-4586-4324-a91b-6632797e92cf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.487308] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9b590a-4586-4324-a91b-6632797e92cf',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.618575] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf55eea-7c35-4863-963a-9034c2b5fa2d: rpc.has_security_group_logging(os_id): False [ 1299.636164] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.636347] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.636394] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.636610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.636704] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.636955] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.637069] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.637134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.637409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.637409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.637522] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1299.696719] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.696876] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.697027] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.697384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.697551] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.709910] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1299.990720] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc9b590a-4586-4324-a91b-6632797e92cf [ 1299.990876] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.991096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.991096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.991307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.992031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.992031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc9b590a-4586-4324-a91b-6632797e92cf already deleted. [ 1299.992031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9b590a-4586-4324-a91b-6632797e92cf" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.576175] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c6ed3b12-912a-4b9e-8ff3-a3046945fbe5 None None] Enqueued Resource ID: 194b3f40-ac5f-4137-be14-4819b0dd4f4d with Priority: HIGHEST for action port [ 1301.576175] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194b3f40-ac5f-4137-be14-4819b0dd4f4d with Priority: HIGHEST for action port [ 1301.576832] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-194b3f40-ac5f-4137-be14-4819b0dd4f4d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.577054] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-194b3f40-ac5f-4137-be14-4819b0dd4f4d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.577191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-194b3f40-ac5f-4137-be14-4819b0dd4f4d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.577504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-194b3f40-ac5f-4137-be14-4819b0dd4f4d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.577610] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194b3f40-ac5f-4137-be14-4819b0dd4f4d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.723941] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1301.724153] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.080627] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 194b3f40-ac5f-4137-be14-4819b0dd4f4d [ 1302.080949] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.081114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.081193] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.081398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.081488] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.081586] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:194b3f40-ac5f-4137-be14-4819b0dd4f4d already deleted. [ 1302.081669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-194b3f40-ac5f-4137-be14-4819b0dd4f4d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.431709] env[65080]: INFO networking_nsxv3.common.synchronization [req-22f22a51-2e10-4714-9297-95e099c70d63 req-2f557f29-4afb-465a-9fd9-1cdfeb3fadd3 tempest-ServerActionsTestOtherA-1272084279 tempest-ServerActionsTestOtherA-1272084279-project-member] Enqueued Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1303.432124] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ec527d-b1df-4719-9613-729c01dff53d with Priority: HIGHEST for action security_group_members [ 1303.432449] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0ec527d-b1df-4719-9613-729c01dff53d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.432581] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.432650] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.432862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.433147] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.433147] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.433363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.433584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.433584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.433584] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0ec527d-b1df-4719-9613-729c01dff53d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.936482] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.936696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.936696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.936937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.937048] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.937276] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.937409] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.937479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.937636] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.937718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.937804] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d is going to be updated. [ 1303.970243] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.970406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.970479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.970677] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.970821] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.979649] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: IN_PROGRESS for 2s [ 1304.855334] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-4d2e5409-d45b-41f3-9462-205256a4871a tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1304.855865] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1304.856187] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.856314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.856384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.856721] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.856799] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.856887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.856935] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.857097] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.857183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.857303] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.142389] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.142590] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.142712] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.143050] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.143312] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.143472] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.143588] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.143806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.143946] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.144170] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1305.144281] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1305.144387] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1305.144493] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1305.144598] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1305.144695] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1305.144821] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1305.163804] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1305.163960] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1305.164087] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1305.164255] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.164555] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.164728] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.164845] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.165155] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.165293] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f97c32-9b3c-49c9-bee7-d4e9655ea69e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.359695] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.359895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.359895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.360095] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.360241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.360425] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.360594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.360661] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.360797] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.360875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.360963] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 already deleted. [ 1305.361058] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.667997] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.667997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.667997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.667997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.668336] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.668336] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 66f97c32-9b3c-49c9-bee7-d4e9655ea69e not found, creating... [ 1305.668566] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.668731] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.668847] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.669071] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.669208] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.669545] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.669704] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.669806] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.670015] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.670157] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.670296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 66f97c32-9b3c-49c9-bee7-d4e9655ea69e is going to be created. [ 1305.689366] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.689574] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.689687] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.689930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.690170] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.690390] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.989886] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0ec527d-b1df-4719-9613-729c01dff53d in Status: SUCCESS [ 1305.990240] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0ec527d-b1df-4719-9613-729c01dff53d deletion is rescheduled due to dependency. [ 1305.990240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0ec527d-b1df-4719-9613-729c01dff53d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.404786] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-4d8f4e50-21fa-4652-8882-28e16a3afbb2 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1306.404956] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-4d8f4e50-21fa-4652-8882-28e16a3afbb2 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1306.405111] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-4d8f4e50-21fa-4652-8882-28e16a3afbb2 service nova] Enqueued Resource ID: 66f97c32-9b3c-49c9-bee7-d4e9655ea69e with Priority: HIGHEST for action port [ 1306.405338] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1306.405471] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1306.405569] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f97c32-9b3c-49c9-bee7-d4e9655ea69e with Priority: HIGHEST for action port [ 1306.406130] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.406271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.406312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.406584] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.406746] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.407912] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.407912] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.408018] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.408138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.408281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.408382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.408443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.408600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.408657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.409804] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.409804] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.410103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.410103] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.410180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.410225] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f97c32-9b3c-49c9-bee7-d4e9655ea69e',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.912052] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.913013] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.913181] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.913291] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66f97c32-9b3c-49c9-bee7-d4e9655ea69e with status ACTIVE [ 1306.913450] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.913561] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.913627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.913820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.913916] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.914079] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.914180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.914238] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.914387] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.914465] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.914712] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.914792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.914792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.915184] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.915343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.915476] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66f97c32-9b3c-49c9-bee7-d4e9655ea69e is going to be updated. [ 1306.935718] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.935871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.935909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.936133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.936269] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.936426] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f97c32-9b3c-49c9-bee7-d4e9655ea69e" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.980515] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-3c325821-ff63-4241-869b-0ea7a1ebec81 tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1306.981044] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1306.981344] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.981450] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.267079] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.267423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.267423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.267565] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.267817] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.267972] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.268095] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.268306] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.268446] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.268649] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.268759] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.268864] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.268969] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.269086] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.269188] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.269314] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.287318] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.287530] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1307.287863] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.287863] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.288124] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.288290] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.288412] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.288728] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.288999] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.417713] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.790931] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.791218] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.791360] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.791666] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.791821] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.791993] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 not found, creating... [ 1307.792295] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.792473] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.792597] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.792830] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.792995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.793303] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.793471] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.793597] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.793839] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.793984] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.794156] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 is going to be created. [ 1307.813280] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.813477] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.813602] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.813862] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.814093] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.814311] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.920112] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.920427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.920427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.920598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.920598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.920725] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be created. [ 1307.946036] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.946323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.946323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.946487] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.946654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.963080] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: UNINITIALIZED for 2s [ 1308.574967] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-aaada720-565e-48a4-908d-3f4fe53b2bb2 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1308.575356] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-aaada720-565e-48a4-908d-3f4fe53b2bb2 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1308.575356] env[65080]: INFO networking_nsxv3.common.synchronization [req-d5591ada-da83-4729-bf8e-6db425a7440f req-aaada720-565e-48a4-908d-3f4fe53b2bb2 service nova] Enqueued Resource ID: e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 with Priority: HIGHEST for action port [ 1308.575688] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1308.575844] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1308.575947] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 with Priority: HIGHEST for action port [ 1308.576471] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.576576] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.576772] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.576855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.577048] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.577156] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.577221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.577444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.577532] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.082024] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 with status ACTIVE [ 1309.082264] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.082467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.082467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.082718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.082855] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.083095] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.083206] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.083271] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.083436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.083530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.083731] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.083817] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.083881] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.084034] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.084114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.084199] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25 is going to be updated. [ 1309.107807] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.108011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.108011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.108231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.108377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.108540] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e54874ab-6f40-4e9c-b88a-0e2fc2e5ce25" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.974514] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1309.974514] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.974882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.974882] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.975680] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.975680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.975680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.975680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.975680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.975680] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.975680] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.976692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.976897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.977009] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.977122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.977871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.977871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.977871] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.977871] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.479761] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.480035] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.480103] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.982470] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.485559] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.485758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.485758] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.486025] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.486125] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.486230] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1311.517476] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.517698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.517698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.517895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.518036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.527932] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1312.724898] env[65080]: INFO networking_nsxv3.common.synchronization [None req-586e022a-e522-4522-9394-3812d28ad599 None None] Enqueued Resource ID: 869e17b2-5469-4a3a-a6ef-a7b5fb930266 with Priority: HIGHEST for action port [ 1312.724898] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869e17b2-5469-4a3a-a6ef-a7b5fb930266 with Priority: HIGHEST for action port [ 1312.724898] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-869e17b2-5469-4a3a-a6ef-a7b5fb930266 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.724898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-869e17b2-5469-4a3a-a6ef-a7b5fb930266" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.724898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-869e17b2-5469-4a3a-a6ef-a7b5fb930266" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.724898] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-869e17b2-5469-4a3a-a6ef-a7b5fb930266" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.724898] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('869e17b2-5469-4a3a-a6ef-a7b5fb930266',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.228067] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 869e17b2-5469-4a3a-a6ef-a7b5fb930266 [ 1313.228217] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.228839] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.228930] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.229164] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.229254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.229483] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:869e17b2-5469-4a3a-a6ef-a7b5fb930266 already deleted. [ 1313.229483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-869e17b2-5469-4a3a-a6ef-a7b5fb930266" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.544296] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1313.544602] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.544801] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.545094] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.545330] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.545461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.545532] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.545762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.545875] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.545979] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.049266] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.551987] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.875852] env[65080]: INFO networking_nsxv3.common.synchronization [None req-c6e5ba6f-2546-4bec-88db-3a0a87ff78dc None None] Enqueued Resource ID: 66d66329-151d-48eb-a6b8-2adadfc2fda4 with Priority: HIGHEST for action port [ 1314.876478] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66d66329-151d-48eb-a6b8-2adadfc2fda4 with Priority: HIGHEST for action port [ 1314.876787] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-66d66329-151d-48eb-a6b8-2adadfc2fda4 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.876909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66d66329-151d-48eb-a6b8-2adadfc2fda4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.876978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66d66329-151d-48eb-a6b8-2adadfc2fda4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.877245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66d66329-151d-48eb-a6b8-2adadfc2fda4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.877363] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66d66329-151d-48eb-a6b8-2adadfc2fda4',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.054984] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.055380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.055380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.055538] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.055638] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.055745] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1315.086531] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.086749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.086749] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.086862] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.087022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.097620] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1315.379556] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66d66329-151d-48eb-a6b8-2adadfc2fda4 [ 1315.379867] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.380049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.380132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.380398] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.380527] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.380628] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66d66329-151d-48eb-a6b8-2adadfc2fda4 already deleted. [ 1315.380730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66d66329-151d-48eb-a6b8-2adadfc2fda4" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.108393] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1317.108678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.108794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.109017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.109206] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.109320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.109384] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.109564] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.109648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.109733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.109886] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.109978] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.110051] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.110191] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.110335] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.110457] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.110518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.110659] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.110732] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.110811] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.110906] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.613335] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b00087fd-2d86-4677-baeb-8e16ff4bde01: rpc.has_security_group_logging(os_id): False [ 1317.630262] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.630434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.630434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.630694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.630787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.630996] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.631114] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.631179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.631321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.631401] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.631578] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.631670] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.631729] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.631867] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.631941] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.632143] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.632236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.632294] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.632430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.632503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.632589] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be created. [ 1317.690827] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.691119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.691119] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.691250] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.691404] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.701599] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1319.396599] env[65080]: INFO networking_nsxv3.common.synchronization [req-ab4ab11a-4010-4b3c-b537-184f71085c56 req-c249860c-8e46-4302-a5a5-02d188a0346e tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1319.397190] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1319.398836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.398836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.398836] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.399851] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.403685] env[65080]: INFO networking_nsxv3.common.synchronization [req-c85c856d-1af2-4e35-b16a-83888b6a64ae req-a04c5002-e54a-4a28-becd-94317bb37a79 tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1319.403685] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1319.403685] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.403685] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.714842] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1319.715082] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.715259] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.715484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.715574] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.760892] env[65080]: INFO networking_nsxv3.common.synchronization [req-b7dc62ae-b8cd-400f-9f59-22f2936dbd04 req-8e7154b0-96f6-44da-b25f-2bd59dd152c1 tempest-ServerRescueTestJSON-946333147 tempest-ServerRescueTestJSON-946333147-project-member] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1319.761280] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1319.761587] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.761716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.761767] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.762050] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.762212] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.762316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.762380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.762530] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.762640] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.762759] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.902393] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.902393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.902696] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.903632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.903632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.903632] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.903632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.903865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.904418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.904418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.904418] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1319.932641] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.933353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.933353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.933353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.933570] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.942693] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1320.097548] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.097759] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.097882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.098231] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.098491] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.098648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.098764] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.098976] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.099130] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.099336] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.099447] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.099588] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.099699] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.099810] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1320.099915] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.100059] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.119030] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.119030] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1320.119247] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.119286] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.119637] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.119811] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.119930] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.120278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.120415] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9169c635-40a2-46d5-a5e2-a8f8fa06aee9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.234883] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.235107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.235107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.235249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.235340] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.235438] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be deleted. [ 1320.266197] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.266393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.266434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.266649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.266815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.267034] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.267139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.267202] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.267362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.267442] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.267548] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b already deleted. [ 1320.267624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.291919] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.292155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.292155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.292360] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.292453] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.292672] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.625038] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.625038] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.625038] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.625038] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.625478] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.625478] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 not found, creating... [ 1320.625604] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.625717] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.625834] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.626055] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.626193] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.626459] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.626613] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.626729] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.627068] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.627068] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.627214] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 is going to be created. [ 1320.651790] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.652106] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.652156] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.652421] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.652648] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.652867] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.332012] env[65080]: INFO networking_nsxv3.common.synchronization [req-b7dc62ae-b8cd-400f-9f59-22f2936dbd04 req-ed2c8d15-7be1-4f60-a648-6c00a009e152 service nova] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_rules [ 1321.332203] env[65080]: INFO networking_nsxv3.common.synchronization [req-b7dc62ae-b8cd-400f-9f59-22f2936dbd04 req-ed2c8d15-7be1-4f60-a648-6c00a009e152 service nova] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1321.332343] env[65080]: INFO networking_nsxv3.common.synchronization [req-b7dc62ae-b8cd-400f-9f59-22f2936dbd04 req-ed2c8d15-7be1-4f60-a648-6c00a009e152 service nova] Enqueued Resource ID: 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 with Priority: HIGHEST for action port [ 1321.332865] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_rules [ 1321.333023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1321.333125] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 with Priority: HIGHEST for action port [ 1321.333401] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.333560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.333607] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.333827] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.333932] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.334723] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.334844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.334909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.335085] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.335281] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.335328] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.335383] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.335519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.335611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.335699] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.336799] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.336870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.336870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.337088] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.337138] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9169c635-40a2-46d5-a5e2-a8f8fa06aee9',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.838382] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.839582] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.839777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.839868] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 with status ACTIVE [ 1321.840029] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.840136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.840220] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.840413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.840499] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.840678] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.840775] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.840834] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.840989] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.841571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.841771] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.841874] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.842046] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.842226] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.842309] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.842397] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9169c635-40a2-46d5-a5e2-a8f8fa06aee9 is going to be updated. [ 1321.872894] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.873134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.873134] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.873331] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.873467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.873633] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9169c635-40a2-46d5-a5e2-a8f8fa06aee9" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.951688] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1321.951863] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 deletion is rescheduled due to dependency. [ 1321.951977] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.952159] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.952379] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.952561] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.952676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.952740] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.952887] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.952966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.953077] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.344559] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.455295] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.455504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.455504] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.455789] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.455885] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.456108] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.456218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.456282] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.456429] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.456506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.456592] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be deleted. [ 1322.487946] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.488122] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.488162] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.488357] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.488441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.488539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.847259] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.847693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.847693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.847693] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.847804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.847884] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be created. [ 1322.870333] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.870510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.870559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.870765] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.870926] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.879909] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: UNINITIALIZED for 2s [ 1324.890727] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1324.890985] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.891132] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.891377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.891572] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.891690] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.891757] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.891909] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.891993] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.892096] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.892188] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.395362] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.395502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.395502] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.395678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.395852] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.396436] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.396526] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.396701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.396795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.396892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.397061] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.397161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.397222] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.397363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.397503] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.397594] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.397655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.397787] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.397866] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.397948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.398093] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.900025] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fd1bdda-984d-4854-bf72-909a8a3cc15b: rpc.has_security_group_logging(os_id): False [ 1325.917706] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.917880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.917880] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.918135] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.918221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.918460] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.918610] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.918681] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.918833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.918914] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.919128] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.919241] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.919316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.919698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.919698] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.919777] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.919849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.919919] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.920071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.920148] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.920234] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be created. [ 1325.974673] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.974883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.974883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.975165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.975310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.992437] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1326.334510] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.334721] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1328.004588] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1328.004924] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.775191] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-23b8a574-7d84-42f3-84cb-a48d938e1ee1 tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1329.775906] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1329.776360] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.776539] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.776648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.776939] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.777122] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.777249] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.777321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.777516] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.777706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.777706] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.071672] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.071672] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.071836] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.072025] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.072279] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.072454] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.072569] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.072785] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.072922] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.073335] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.073460] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.073567] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.073676] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.073789] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.073892] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.074048] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.094306] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.094476] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1330.094611] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.094873] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.095263] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-0f259a3b-13ac-4be2-bf24-46db47777339 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.095444] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.095567] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.095874] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.096025] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f259a3b-13ac-4be2-bf24-46db47777339',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.280150] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.280371] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.280418] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.281254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.281254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.281254] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.281254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.281254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.281525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.281525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.281525] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 already deleted. [ 1330.281525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.599320] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.599527] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.599673] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.600043] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.600202] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.600355] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 0f259a3b-13ac-4be2-bf24-46db47777339 not found, creating... [ 1330.600636] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.600797] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.600913] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.601146] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.601280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.601599] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.601846] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.601908] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.602099] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.602232] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.602367] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 0f259a3b-13ac-4be2-bf24-46db47777339 is going to be created. [ 1330.621813] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.622052] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.622142] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.622400] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.622628] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.622852] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.334159] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-486d10d0-2776-4da7-a5f7-9104f56dd26c service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1331.334423] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-486d10d0-2776-4da7-a5f7-9104f56dd26c service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1331.334463] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-486d10d0-2776-4da7-a5f7-9104f56dd26c service nova] Enqueued Resource ID: 0f259a3b-13ac-4be2-bf24-46db47777339 with Priority: HIGHEST for action port [ 1331.334995] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1331.335152] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1331.335256] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f259a3b-13ac-4be2-bf24-46db47777339 with Priority: HIGHEST for action port [ 1331.335606] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.335728] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.335900] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.336266] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.336372] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.337231] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.337351] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.337419] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.337652] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.337815] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.337915] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.337983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.338136] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.338223] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.338320] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.339215] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f259a3b-13ac-4be2-bf24-46db47777339 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.339319] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.339370] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.339517] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.339594] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f259a3b-13ac-4be2-bf24-46db47777339',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.841173] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.841341] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.842686] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.843818] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f259a3b-13ac-4be2-bf24-46db47777339 with status ACTIVE [ 1331.844040] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.844161] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.844252] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.844462] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.844559] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.844734] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.844833] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.844895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.845059] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.845139] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.845325] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.845420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.845481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.845618] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.845694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.845779] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f259a3b-13ac-4be2-bf24-46db47777339 is going to be updated. [ 1331.867016] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.867571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.867571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.867571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.867783] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.867828] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f259a3b-13ac-4be2-bf24-46db47777339" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.947348] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-22b706d9-1ce9-4bfb-aa7c-7f9cc81f55b8 tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1331.947991] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1331.948274] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.948382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.208573] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.208782] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.208912] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.209204] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.209462] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.209665] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.209784] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.209980] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.210140] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.210348] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.210477] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.210655] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.210778] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.210898] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.211018] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.211151] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.228961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.229144] env[65080]: DEBUG dogpile.cache.region [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1332.229259] env[65080]: DEBUG dogpile.lock [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.229423] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "network-105" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.229784] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock port-788462ce-bd1f-4d37-a9bc-6d802afe3467 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.229976] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.230073] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.230390] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.230526] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788462ce-bd1f-4d37-a9bc-6d802afe3467',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.347546] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.732425] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.732650] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.732777] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.733059] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.733208] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.733363] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Segment Port 788462ce-bd1f-4d37-a9bc-6d802afe3467 not found, creating... [ 1332.733615] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.733773] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.733889] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.734138] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.734271] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.734543] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.734693] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.734809] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.735014] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.735151] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.735285] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Resource: SegmentPort with ID: 788462ce-bd1f-4d37-a9bc-6d802afe3467 is going to be created. [ 1332.753977] env[65080]: DEBUG networking_nsxv3.common.locking [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.754212] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.754334] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.754589] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.754807] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.755028] env[65080]: DEBUG oslo_concurrency.lockutils [None req-00dec74f-bde2-4ff3-9240-3c0bed845e75 None None] Releasing lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.850017] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.850234] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.850321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.850573] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.850691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.850809] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be created. [ 1332.962756] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.962954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.962954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.963197] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.963380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.003332] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: UNINITIALIZED for 2s [ 1333.474665] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-4467f632-7d67-44f1-8894-5a4a5fc2b922 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1333.474956] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-4467f632-7d67-44f1-8894-5a4a5fc2b922 service nova] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1333.475070] env[65080]: INFO networking_nsxv3.common.synchronization [req-1d623c30-428e-4784-a03a-10b94dd39f2e req-4467f632-7d67-44f1-8894-5a4a5fc2b922 service nova] Enqueued Resource ID: 788462ce-bd1f-4d37-a9bc-6d802afe3467 with Priority: HIGHEST for action port [ 1333.475484] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_rules [ 1333.475621] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1333.475721] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788462ce-bd1f-4d37-a9bc-6d802afe3467 with Priority: HIGHEST for action port [ 1333.475989] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.476578] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.476798] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.476890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.477087] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-788462ce-bd1f-4d37-a9bc-6d802afe3467 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.477236] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.477314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.477519] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.477602] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788462ce-bd1f-4d37-a9bc-6d802afe3467',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.980128] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 788462ce-bd1f-4d37-a9bc-6d802afe3467 with status ACTIVE [ 1333.980354] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.980624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.980624] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.980804] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.980889] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.981063] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.981155] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.981327] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.981441] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.981529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.981720] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.981820] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.981870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.982016] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.982093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.982355] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 788462ce-bd1f-4d37-a9bc-6d802afe3467 is going to be updated. [ 1334.003929] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.004111] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.004183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.004393] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.004511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.004656] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788462ce-bd1f-4d37-a9bc-6d802afe3467" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.013958] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1335.014312] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.014413] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.014716] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.014987] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.015138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.015207] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.015390] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.015484] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.015601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.015705] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.016613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.016777] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.016955] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.017086] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.017150] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.017308] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.017389] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.017477] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.521077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.521077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.521077] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.023634] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.526911] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.527127] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.527180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.527380] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.527475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.527589] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1336.556654] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.556654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.556654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.556654] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.556923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.565591] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1338.476500] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.476900] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1338.576217] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1338.576434] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.576611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.576896] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.577107] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.577248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.577314] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.577475] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.577556] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.577667] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.080186] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.582540] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.085788] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.086019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.086019] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.086210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.086304] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.086406] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1340.114018] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.114248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.114248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.114503] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.114590] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.124081] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1342.136067] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1342.136439] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.136575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.136879] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.137172] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.137365] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.137474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.137684] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.137815] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.137949] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.138204] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.138343] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.138421] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.138597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.138806] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.138954] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.139053] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.139233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.139329] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.139430] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.139528] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.641546] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b00087fd-2d86-4677-baeb-8e16ff4bde01: rpc.has_security_group_logging(os_id): False [ 1342.658917] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.659133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.659133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.659291] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.659377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.659599] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.659701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.659802] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.659953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.660043] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.660231] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.660324] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.660385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.660522] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.660596] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.660777] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.660886] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.660948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.661110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.661183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.661267] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be created. [ 1342.721477] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.721706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.721706] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.721883] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.722110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.734494] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1343.321966] env[65080]: INFO networking_nsxv3.common.synchronization [req-af77b1c2-274c-4b4b-b70e-1208f54d9e54 req-fdb9e546-8bb6-4ec9-925a-31fa70738874 tempest-ServerRescueTestJSON-946333147 tempest-ServerRescueTestJSON-946333147-project-member] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1343.322427] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1343.322741] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.322870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.323008] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.323151] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.323304] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.323405] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.323467] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.323615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.323701] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.323798] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.673024] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.673024] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.673024] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.673024] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.673024] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.673438] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.673715] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.674075] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.674333] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.674656] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1343.674895] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.675124] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.675328] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.675557] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1343.676584] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.676584] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.707684] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.707923] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1343.708085] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.708280] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-790" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.708611] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-0e3aaa12-44ec-42ce-a86f-40278efa56d5 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.708790] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.708911] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.709278] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.709422] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3aaa12-44ec-42ce-a86f-40278efa56d5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.825754] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.201053] env[65080]: INFO networking_nsxv3.common.synchronization [req-f86c5ad6-241c-4128-87ec-84200a12d231 req-407ec0db-aa3b-4d57-af17-ecf3dcad52c8 tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1344.201053] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1344.201268] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.201438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.201593] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.201903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.202251] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.202373] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.202511] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.202786] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.202966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.203170] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.212761] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.212761] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.212997] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.213114] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.213261] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.213414] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 0e3aaa12-44ec-42ce-a86f-40278efa56d5 not found, creating... [ 1344.213680] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.213835] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.213950] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.214232] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.214378] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.214663] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.214816] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.214931] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.215479] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.215621] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.215771] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 0e3aaa12-44ec-42ce-a86f-40278efa56d5 is going to be created. [ 1344.241404] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.241721] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.241721] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.241955] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.242213] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.242459] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.328403] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.493503] env[65080]: INFO networking_nsxv3.common.synchronization [req-659ced19-9773-4576-9c09-770db43eb123 req-785f991d-a423-44e2-9f80-dd785662f3ae tempest-MultipleCreateTestJSON-787422846 tempest-MultipleCreateTestJSON-787422846-project-member] Enqueued Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1344.494012] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 with Priority: HIGHEST for action security_group_members [ 1344.494329] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-b00087fd-2d86-4677-baeb-8e16ff4bde01 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.494433] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.705464] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.745384] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1344.745489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.745632] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.745860] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.746042] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.831352] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.831550] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.831601] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.831782] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.831873] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.831972] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be updated. [ 1344.861026] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.861173] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.861221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.861427] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.861575] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.870717] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1344.923602] env[65080]: INFO networking_nsxv3.common.synchronization [req-af77b1c2-274c-4b4b-b70e-1208f54d9e54 req-53fc2bb3-a006-43ab-b3bb-30138d738907 service nova] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_rules [ 1344.923794] env[65080]: INFO networking_nsxv3.common.synchronization [req-af77b1c2-274c-4b4b-b70e-1208f54d9e54 req-53fc2bb3-a006-43ab-b3bb-30138d738907 service nova] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1344.923931] env[65080]: INFO networking_nsxv3.common.synchronization [req-af77b1c2-274c-4b4b-b70e-1208f54d9e54 req-53fc2bb3-a006-43ab-b3bb-30138d738907 service nova] Enqueued Resource ID: 0e3aaa12-44ec-42ce-a86f-40278efa56d5 with Priority: HIGHEST for action port [ 1344.924190] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_rules [ 1344.924325] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1344.924421] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e3aaa12-44ec-42ce-a86f-40278efa56d5 with Priority: HIGHEST for action port [ 1344.924971] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.925110] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.925179] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.925363] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.925440] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.926271] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.926377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.926557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e3aaa12-44ec-42ce-a86f-40278efa56d5 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.926707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.926707] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.926870] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.926944] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3aaa12-44ec-42ce-a86f-40278efa56d5',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.208181] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.267651] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.267872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.267872] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.268115] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.268210] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.268315] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be deleted. [ 1345.334664] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.335093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.335093] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.335170] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.335239] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.335406] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.429014] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.429248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.429553] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e3aaa12-44ec-42ce-a86f-40278efa56d5 with status ACTIVE [ 1345.429824] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.429995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.430072] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.430245] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.430334] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.430515] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.430688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.430688] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.430890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.430890] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.431089] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.431186] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.431248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.431385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.431459] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.431544] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e3aaa12-44ec-42ce-a86f-40278efa56d5 is going to be updated. [ 1345.474223] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.474443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.474443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.474700] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.474844] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.475320] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e3aaa12-44ec-42ce-a86f-40278efa56d5" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.711069] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.711235] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.711277] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.711613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.711613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.711800] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be updated. [ 1345.743065] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.743065] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.743288] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.743330] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.743444] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.752399] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: IN_PROGRESS for 2s [ 1346.882167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1346.882518] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.882627] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.882895] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.883134] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.883278] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.883374] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.883571] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.883669] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.883795] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.386419] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.763017] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 in Status: SUCCESS [ 1347.763017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.763017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.763298] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.763500] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.763628] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.763694] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.763854] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.763938] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.764047] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b00087fd-2d86-4677-baeb-8e16ff4bde01',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.889446] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.266853] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.267128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.267128] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.267310] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.267399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.267598] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.267719] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.267851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.267927] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.268017] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.268111] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b00087fd-2d86-4677-baeb-8e16ff4bde01 is going to be deleted. [ 1348.300991] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.301240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.301240] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.301420] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.301510] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.301611] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b00087fd-2d86-4677-baeb-8e16ff4bde01" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.392571] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.392762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.392851] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.393112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.393209] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.393313] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be updated. [ 1348.424900] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.425133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.425133] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.425336] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.425483] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.434116] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1349.925546] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.926058] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1350.446074] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1350.446074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.446074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.446074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.446560] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.446560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.446560] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.446759] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.446807] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.447049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.447049] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.950041] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.950354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.950354] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.950424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.950574] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.950657] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.950718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.950865] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.950983] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.951113] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.951289] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.951385] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.951447] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.951613] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.951757] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.951850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.951913] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.952060] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.952145] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.952248] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.952345] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.455204] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fd1bdda-984d-4854-bf72-909a8a3cc15b: rpc.has_security_group_logging(os_id): False [ 1351.473986] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.474218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.474218] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.474424] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.474512] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.474728] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.474832] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.474897] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.475068] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.475146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.475321] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.475414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.475474] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.475615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.475691] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.475880] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.475969] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.476041] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.476182] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.476256] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.476342] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be updated. [ 1351.542214] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.542525] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.542597] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.542840] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.543011] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.554231] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1353.569955] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1353.569955] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.926362] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.926722] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.927435] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.927893] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.929023] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.929023] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.873276] env[65080]: INFO networking_nsxv3.common.synchronization [req-d3558d02-a444-4111-be31-b0378d653363 req-5aa786af-1747-4402-9549-054526c252bd tempest-ServerRescueTestJSON-946333147 tempest-ServerRescueTestJSON-946333147-project-member] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1369.873671] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1369.873976] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.874112] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.874183] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.874382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.874538] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.874635] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.874717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.874838] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.874923] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.875027] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.377092] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.879824] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.383077] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.383077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.383077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.383391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.383391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.383459] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be updated. [ 1371.412096] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.412307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.412307] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.412535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.412692] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.421031] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1372.117562] env[65080]: INFO networking_nsxv3.common.synchronization [req-2163a5ee-994c-452c-987d-c742e77d7184 req-f1bbb420-f665-4aea-96a0-b2d51c6437f3 tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1372.118101] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1372.118414] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.118535] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.118603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.118800] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.118958] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.119158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.119231] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.119391] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.119479] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.119871] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.622584] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.622794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.622794] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.623049] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.623146] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.623341] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.623443] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.623506] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.623655] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.623733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.623821] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1372.648914] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.649138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.649138] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.649316] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.649489] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.657167] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1373.432215] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1373.432603] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.667339] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1374.667613] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d deletion is rescheduled due to dependency. [ 1374.667649] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.483653] env[65080]: INFO networking_nsxv3.common.synchronization [req-5fef6e70-65fe-4f54-a1a9-6f6f25250b2c req-b56e9729-4624-492b-860b-73c35a9bf62a tempest-ServerRescueTestJSON-946333147 tempest-ServerRescueTestJSON-946333147-project-member] Enqueued Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1376.484187] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b with Priority: HIGHEST for action security_group_members [ 1376.484730] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd1bdda-984d-4854-bf72-909a8a3cc15b taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.484730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.484730] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.484943] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.485071] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.485165] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.485228] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.485377] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.485461] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.485556] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd1bdda-984d-4854-bf72-909a8a3cc15b',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.987873] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.988158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.988158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.988335] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.988431] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.988634] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.988736] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.988806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.988948] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.989036] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.989126] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b is going to be updated. [ 1377.016746] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.016932] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.016987] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.017180] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.017322] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.025501] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: IN_PROGRESS for 2s [ 1379.036888] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b in Status: SUCCESS [ 1379.037296] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd1bdda-984d-4854-bf72-909a8a3cc15b deletion is rescheduled due to dependency. [ 1379.037296] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd1bdda-984d-4854-bf72-909a8a3cc15b" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.781403] env[65080]: INFO networking_nsxv3.common.synchronization [req-7f9a18d2-1661-402e-bf3d-941b98fb9656 req-ff83d28a-9350-4fa7-bc00-ed59e5efe61b tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1380.781700] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1380.782350] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.782350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.782350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.782350] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.782557] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.782557] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.782678] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.783966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.783966] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.783966] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.068047] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock network-274 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.068216] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.068216] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.068475] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.068727] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.068882] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.068995] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.069215] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.069356] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.069563] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1381.069672] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] NeedRegenerationException {{(pid=65080) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1381.069777] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] no value, waiting for create lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1381.069879] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] value creation lock acquired {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1381.069984] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] No value present for key: 'zone-id' {{(pid=65080) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1381.070107] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Calling creation function for not-yet-present value {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1381.070266] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1381.091038] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1381.091038] env[65080]: DEBUG dogpile.cache.region [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65080) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1381.091038] env[65080]: DEBUG dogpile.lock [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Released creation lock {{(pid=65080) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1381.091038] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "network-274" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.091446] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 taken with stack trace [, , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.091544] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.091662] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.091981] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.092147] env[65080]: DEBUG networking_nsxv3.api.rpc [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d43e8a3-6c18-4a12-ab65-66e9c4e46c68',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.288210] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.288417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.288417] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.288673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.288733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.288908] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.289037] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.289106] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.289257] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.289366] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.289524] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1381.314375] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.314676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.314676] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.314796] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.314906] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.324103] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1381.593974] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.594226] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.594355] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.594623] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.594772] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.594924] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Segment Port 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 not found, creating... [ 1381.595198] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.595408] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.595499] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.595734] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.595931] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.596237] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.596396] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.596515] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.596720] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.596854] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.596989] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Resource: SegmentPort with ID: 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 is going to be created. [ 1381.617171] env[65080]: DEBUG networking_nsxv3.common.locking [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.617532] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.617532] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.617771] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.617986] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.618257] env[65080]: DEBUG oslo_concurrency.lockutils [None req-3ae6aa25-7ea4-438b-b75f-39d04300c7fc None None] Releasing lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.316575] env[65080]: INFO networking_nsxv3.common.synchronization [req-7f9a18d2-1661-402e-bf3d-941b98fb9656 req-d07abb48-eed7-48ef-89b8-bd8aaefa3315 service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 1382.316894] env[65080]: INFO networking_nsxv3.common.synchronization [req-7f9a18d2-1661-402e-bf3d-941b98fb9656 req-d07abb48-eed7-48ef-89b8-bd8aaefa3315 service nova] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1382.317010] env[65080]: INFO networking_nsxv3.common.synchronization [req-7f9a18d2-1661-402e-bf3d-941b98fb9656 req-d07abb48-eed7-48ef-89b8-bd8aaefa3315 service nova] Enqueued Resource ID: 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 with Priority: HIGHEST for action port [ 1382.317643] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_rules [ 1382.317845] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1382.317972] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 with Priority: HIGHEST for action port [ 1382.319872] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.320154] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.320279] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.321221] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.321403] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.322851] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.323081] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.326092] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.326092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.326092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.326092] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.326092] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d43e8a3-6c18-4a12-ab65-66e9c4e46c68',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.830455] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.830600] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.830763] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 with status ACTIVE [ 1382.830930] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.831062] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.831144] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.831378] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.831477] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.831656] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.831755] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.831937] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.832107] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.832185] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.832399] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.832524] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.832598] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.832718] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.832769] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.832961] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d43e8a3-6c18-4a12-ab65-66e9c4e46c68 is going to be updated. [ 1382.855570] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.855751] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.855790] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.858074] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.858254] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.858460] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d43e8a3-6c18-4a12-ab65-66e9c4e46c68" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.334340] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1383.334717] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d deletion is rescheduled due to dependency. [ 1383.334717] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.334792] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.334999] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.335199] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.335321] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.335399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.335568] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.335648] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.335790] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.838172] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.341910] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.844454] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.844615] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.844703] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.845071] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.845233] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.845383] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1384.872674] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.872850] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.872918] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.873171] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.873345] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.882465] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1386.894020] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1386.894399] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.894438] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.894645] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.894837] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.894953] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.895029] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.895194] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.895276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.895362] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.895454] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.320617] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.320867] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1387.397493] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.899375] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cdf55eea-7c35-4863-963a-9034c2b5fa2d: rpc.has_security_group_logging(os_id): False [ 1387.916575] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.916762] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.916806] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.917021] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.917118] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.917410] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.917545] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.917614] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.917771] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.917847] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.917936] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1387.974836] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.975031] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.975077] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.975267] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.975414] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.986938] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1390.001519] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1390.001770] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.322308] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.322743] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.322848] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.323305] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.323971] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.323971] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.325114] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.325539] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.326373] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.326788] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.327696] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.328178] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.329433] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.329940] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.331025] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.331402] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.332478] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.332859] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.334293] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.334609] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.598263] env[65080]: INFO networking_nsxv3.common.synchronization [req-2b747256-fc2f-4f89-8fd8-0f6400d88275 req-9d64ddb4-0447-40a1-86ec-fe0488d70fbd tempest-ServerActionsTestJSON-1077727823 tempest-ServerActionsTestJSON-1077727823-project-member] Enqueued Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1441.598569] env[65080]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d with Priority: HIGHEST for action security_group_members [ 1441.598727] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock member-cdf55eea-7c35-4863-963a-9034c2b5fa2d taken with stack trace [, , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.599276] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.599382] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.599529] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.599687] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.599795] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.599903] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.599995] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.600087] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.600182] env[65080]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cdf55eea-7c35-4863-963a-9034c2b5fa2d',) {} {{(pid=65080) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.102169] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.102353] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.102481] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.102609] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.102733] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.102918] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.103091] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.103158] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.103323] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.103422] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.103502] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d is going to be updated. [ 1442.153426] env[65080]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65080) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.153673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.153673] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.153892] env[65080]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.154022] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.162252] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: IN_PROGRESS for 2s [ 1444.173849] env[65080]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d in Status: SUCCESS [ 1444.173849] env[65080]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cdf55eea-7c35-4863-963a-9034c2b5fa2d deletion is rescheduled due to dependency. [ 1444.173849] env[65080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cdf55eea-7c35-4863-963a-9034c2b5fa2d" {{(pid=65080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.599414] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.599776] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.601056] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.601056] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.601907] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.602294] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.603169] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.603483] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.604877] env[65080]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.605268] env[65080]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0